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ABSTRACT 

A void exists between the rapid growth of post-high 
school trade and technical education and the development of 
educational management tools for that area. Hoping to help fill this 
void, this research effort concentrated on the development of 
psychometric instruments useful in measuring achievements. Trade and 
technical areas involved in the study include electrical installation 
and maintenance, machinists, electronics, and data processing. The 
tests developed for these and other areas provide objective, 
reliahle, and valid indices of the level of proficiency achieved by 
students and will provide teachers, administrators, and researchers 
with a tool for more effective management of their programs. Although 
the tests are not included in this report for security reasons, the 
information does include (1) detailed test specifications, (2) 
descriptions of the samples, (3) reliability of subtests, (4) 
intercorrelaticns of subtests, (5) correlations with other 
standardized measures of achievement, norms, and other psychometric 
data. Also for each curriculum, detailed information is presented on 
the test specifications, sample, and psychometric characteristics of 
both the experimental and final forms of the test. (Author/JS) 



VT<7 X^OlC 



sO 

f\l 

IfN 

■ 4 - 

- 4 * 



UJ 



FINAL REPORT 
Project No. 5-1319 
Grant No. OEG-0-8-051319-3626 (085) 



THE DEVELOPMENT OF ACHIEVEMENT MEASURES FOR 
TRADE AND TECHNICAL EDUCATION 



Thomas S. Baldwin 
University of Illinois 
Urbana, Illinois 



September 1970 



VI v ."ARTUIHt Of HIAITK, tOVCATKM 

tmu«M 

o» net or (ovcmiom 
tXXWtKT KA* I iu fttfftooucto 
IXACUV Ai MClfVtO tto* TMl MttOft 0 * 
OttlHUAlOH CAKHHATlNG IT KMftlTf Of 
V\t* 0 A 0 ** 0 *% »UTtt> 00 l»Ot *C!$ 
iAMtv *tP*<it*TC*ncui ornci Of iou 

CAT** potmo* OA KM Or 



The research reported herein was performed pursuant to a grant with 
the Office of Education, U.S. Department of Health, Education, and 
Welfare. Contractors undertaking such projects under Government 
sponsorship are encouraged to express freely their professional 
judgment in the conduct of the project. Points of view or opinions 
stated do not, therefore, necessarily represent official Office of 
Education position or policy. 



U.S. DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE 

Office of Education 
Bureau of Research 




ACKNOWLEDGEMENTS 



The success of any major research undertaking to a great extent 
depends upon the availability of competent **nd motivated staff. While 
the research reported on here is no exception to this rule, it is ex- 
ceptional in that few projects have enjoyed the benefits of «uch a 
highly motivated and competent staff. To the extent that this project 
makes a contribution to vocational and technical education it has been 
through the efforts of the individuals listed below. All of them were 
formally affiliated with the project and generously contributed their 
time, advice, and scholarly assistance to make the project possible. 

ASSISTANT PROJECT DIRECTOR: Charles F. Ward 

RESEARCH ASSOCIATES: Bruce H. Kemelgor, James B. Jones 

GRADUATE ASSISTANTS! 

University of Illinois ! Wayne Becker, Robert Harris, 

Jarrel Hoffer, Richard Swanson, Conard White 

North Carolina State University ! Kersey Antla, William Ballenger 
Stanley Epstein, David Friedman, Chris Hsu, Robert Markman, 
Lloyd Spaulding, Thomas Tuttle, Thomas Weiss 

SECRETARIES: 

University of Illinois ! Rose Watts 

North Carolina State University : Linda Baker, Mabel Rountree 
FACULTY: 

University of Illinois : Dr. George Frost 

North Carolina State University : Dr. John Coster, 

Dr. Clyde Johnson 

Many other individuals, too numerous to list individually, 
also made significant contributions to this project. These included 
members of the staff of participating institutions, members of item 
writing committees, members of state departments of education, and 
others. To all of these, much credit and appreciation is due for 
their assistance. 



Thomas S. Baldwin, Ph.D. 
Principal Investigator 



11 



TABLE OF CONTENTS 



CHAPTER PAGE 

I INTRODUCTION 1 

II RATIONALE 3 

III PROCEDURES 7 

IV DATA PROCESSING 21 

V ELECTRONICS 35 

VI AUTOMOTIVE MECHANICS 45 

VII MACHINIST 55 

VIII AIR CONDITIONING, HEATINC AND REFRIGERATION .... 65 

IX ELECTRICAL INSTALLATION AND MAINTENANCE 75 

X RADIO AND TELEVISION SERVICING ........... 85 

XI DIAGNOSTIC PERFORMANCE MEASURES 95 

APPENDIX 101 



111 



O 

ERIC 

hfliflaffHEraaaa 



LIST OF TABLES 



CHAPTER IV DATA PROCESSING PAGE 

IV-1 Test Specifications 23 

IV-2 First Year Description of Sample 25 

IV-3 Experimental Tests Description and Reliabilities 25 

IV-4 Form A-Experimental Test Intercorrelations and 

Factor Loadings 26 

IV-5 Form B-Experimental Test Intercorrelations and 

Factor Loadings 27 

IV-6 Business-Second Year Description of Sample 28 

IV-7 Scientific-Second Year Description of Sample 28 

IV-8 Scientific-Final Test Psychometric Characteristics 29 

IV-9 Scientific-Final Test Subtest Intercorrelations 29 

IV-10 Business-Final Test Psychometric Characteristics 30 

IV-11 Business-Final Test Subtest Intercorrelations 30 

IV-12 Business-Subfests Raw Score Conversions 31 

IV-13 Business-Total Test Raw Score Conversion 32 

IV-14 Sclentlf lc-Subtests Raw Score Conversions 33 

IV- 15 Scientific-Total Test Raw Score Conversions 34 

CHAPTER V ELECTRONICS 

V- l Test Specifications 36 

V-2 First Year Description of Sample 38 

V-3 Experimental Tests Description and Reliabilities 38 

V-4 Form A-Experlmental Test 

Intercorrelations and Factor Loadings 39 

V-5 Form B-Experlmental Test 

Intercorrelations and Factor Loadings 40 

V-6 Second Year Description of Sample 41 

V-7 Final Test Psychometric Characteristics 42 

V-8 Final Test Subtest Intercorrelatiotts 43 

V-9 Subtests Raw Score Conversions 43 

V- 10 Total Test Raw Score Conversions 44 

CHAPTER VI AUTOMOTIVE MECHANICS 

VI- 1 Test Specifications 46 

VI-2 First Year Description of Sample 48 

VI-3 Experimental Tests Description and Reliabilities 48 

VI-4 Form A-Experimental Test 

Intercorrelations and Factor Loadings 49 

VI-5 Form B-Experlmental Test 

Intercorrelations and Factor Loadings 50 

VI-6 Second Year Description of Sample 51 

VI-7 Final Test Psychometric Characteristics 52 

Vl-8 Final Test Subtest Intercorrelations 52 



VI-9 Subtests Raw Score Conversions 53 

VI- 10 Total Ter.t Raw Score Conversions 54 

CHAPTER VII MACHINIST 

VII- 1 Test Specifications 56 

VII-2 First Year Description of Sanple 57 

VII-3 Experimental Tests Description and Reliabilities 57 

VII-4 Form A- Experimental Test 

Intercorrelations and Factor Loadings 58 

VII-5 Fora B-Experimenta.l Test 

Intercorrelations and Factor Loadings 59 

VII-6 Second Year Description of Sample 60 

VII-7 Final Test Psychometric Characteristics 61 

VII-8 Final Test Subtest Intercorrelations 61 

VII-9 Subtests Raw Score Conversions 62 

VII- 10 Total Test Raw Score Conversions 63 

CHAPTER VIII AIR CONDITIONING, HEATING, AND REFRIGERATION 

VIII- 1 Test Specifications 66 

VIIT*2 First Year Description of Sample 69 

VIII- 3 Experimental Tests Description and Reliabilities 69 

VIII-4 Intercorrelat ions and Factor Loadings 70 

VIII-5 Second Year Description of Sample 71 

VIII-6 Final Test Psychometric Characteristics 72 

VIII-7 Final Test: Subtest Intercorrelations 72 

VI1I-8 Subtests Raw Score Conversions 73 

VIII- 9 Total Test Raw Score Conversions 74 

CHAPTER IX ELECTRICAL INSTALLATION AND MAINTENANCE 

IX- 1 Test Specifications 76 

IX-2 First Year Description of Sample 78 

IX-3 Experimental Testo Description and Reliabilities 78 

IX-4 Form A-Experimental Test 

Intercorrelations and Factor Loadings 79 

IX-5 Form B-Experimental Test 

Intercorrelationa and Factor Loadings 80 

IX-6 Second Year Description of Sanple 81 

IX-7 Final Test Psychometric Characteristics 82 

IX-8 Final Test Subtest Intercorrelationa 82 

IX-9 Subtests Rav Score Conversions 83 

IX- 10 Total Test Raw Score Conversions 84 

CHAPTER X RADIO-TELEVISION SERVICING 

X- l Test Specifications 86 

X-2 First Year Description of Sample 87 



O 




88 



X-3 Experimental Tests Description and Reliabilities 



X-4 Form A-Experin e o t a l Test 

Intercorrelatioos and Factor Loadings 89 

X-5 Form B- Experimental Test 

in ter cor relations and Factor Loadings 90 

X-6 Second Year Description of Sanple 91 

X-7 Final Test Psychometric Characteristics 92 

X-8 Final Test Sub test Intercorrelations 92 

X-9 Sub tests Raw Score Conversions 93 

X-10 Total Test Raw Score Conversions 94 



vi 




CHAPTER I 



INTRODUCTION 

No segment of education has grown so rapidly in the last few 
decades as that representing the post high school sub-baccalaureate 
level. This segment of education, which encompasses many different 
types of programs offered in junior colleges, community colleges, 
technical institutes, etc., is widely recognized as being one of the 
most appropriate solutions to many of our societal problems. Regard- 
less of the type of institution operating at this leve^ one common 
thread found in virtually all of them is emphasis on trade and tech- 
nical education. This widespread emphasis is Implicit recognition of 
the fact that such programs have great potential for the economic 
growth of this country. 

While this nationwide emphasis on post high school trade and 
technical education is fulfilling an important need, the maximum 
utility of the system has not been achieved by the very fact of its 
rapid growth. Many of the "tools" of educational management that are 
well known and widely used at the elementary, secondary, and college 
level have evolved with these levels of education over a long period 
of time. The rapid growth of post high school trade and technical 
education, however, has resulted in a lag in the development of 
educational management tools appropriate for that level. 

It is toward the development of one such tool, standardized 
achievement tests, that this research was directed. The widespread 
use in other segments of education of standardized psychometric 
instruments for assessing student potential, interests, achievement, 
etc., is widely known. One has only to look at the phenomenal growth 
of organizations such us Educational Testing Service over the last 
twenty-five years to realize the heavy reliance that educators place 
on psychometric instruments for use in operating their programs. The 
present research was undertaken to provide psychological tests, similar 
to those that have been so highly useful in other areas of education, 
to some segments of post high school trade and technical education. 

More specifically, this research dealt with the development of 
psychometric Instruments for measuring achievement in selected trade 
and technical education programs at the post high school level. The 
trade areas selected for study included; electrical Installation and 
maintenance} radio and television servicing, air conditioning, heating 
and refrigeration} automotive mechanics; and machinists. The technical 
areas selected for study were electronics and data processing. These 
tests provide objective, reliable, and va*id indices of the level of 
proficiency achieved by students and will provide teachers, administra- 
tors, and researchers with a tool for more effective management 
of their educational programs. 
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The present technical report covers the entire period of re- 
search and presents the rationale, procedures, and psychometric recalls 
for each of the areas mentioned above. Since the utility of the 
instruments developed during the course of this research program depends 
upon adequate test security, the instruments themselves are not in- 
cluded with this report. These instruments, which have been published 
separately, will be made available on an operational basis tv Interest ted 
educational institutions. However, the present report presents all 
of the technical information necessary for an institution to determine 
the appropriateness of the instruments for their curricula. Thin 
information Includes detailed test specifications, descriptions of cite 
samples, reliability of sub tests, intercorrelations of subtests, 
correlations with other standardized measures of achievement, norm, 
and other psychometric data. The tests produced under this grant are 
listed below. 

Achievement Test for Machinist 

Auditory Achievement Test for Machinist 

Achievement Test for Radio and Television Servicing 

Visual Diagnostic Test for Television Servicing 

Achievement Test for Air Conditioning, Heating and Refrigeration 

Achievement Test for Automotive Mechanics 

Auditory Achievement Test for Automotive Mechanics 

Achievement Test for Electrical Installation and Maintenance 

Achievement Test for Data Processing Technology - Business 

Achievement Test for Data Processing Technology - Scientific 

Achievement Test for Electronics Technology 

This report is organized in several chapters. Chapter It <deais 
with the overall program rationale and provides information on the 
decisions which were reached in the early part of the program regarding 
the selection of curriculum areas for study, selection of the environ- 
ment in which the research would be conducted, and other Information 
pertaining to the overall research program. 

Chapter III deals with the procedures used in conducting this 
research and again is applicable to all curricula. Details are given 
regarding advisory committees, consultants, staff composition, item t- 
writing committees, etc. Further detail is provided on how the various 
curricula were analyzed, weighted according to importance, and how 
items were generated, te8ted, and selected for inclusion in the final 
instruments. 

Each of the chapters IV through X deals with the specific oarr Uahm 
with which this research was concerned. For each curriculum, detailed 
information la presented on the test specifications, sample , and paydbo- 
netric characteristics of both the experimental and final forms of the 
test. It is in these chaptere that a potential user of the Imtr i ird a 
will find detailed information which should be useful in making a 
decision regarding the appropriateness of the instrument for his particu- 
lar purposes. 
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CHAPTER II 



RATIONALE 



A. SELECTION OF ENVIRONMENT 

In 1956 the North Carolina General Aaaenbly ^aanted 
tlon providing for a statewide system of "Indus trial education aa ptfan g ^ * 1 
the purpose of which was to provide both high school and a>oa± tfi&h 
school students training In vocational and technics'll education. HJy 
the fall of 1963 twenty such institutions had been established aa m c 
the state and were serving the full-time equivalent of B366 anitatte.^ 

In 1963 the North Carolina General Assembly enacted UqgMhtilliiP 
which created a system of "community colleges, technical ilnatltatta^r 
and industrial education centers" which provided f or dtte ccxeahlor. off 
new institutions of each type and also provided that -previoud^y eaat&b- 
llshed industrial education centers could evolve into teCbnladl lir— 
stitutes or community colleges as the need arose. 2 By tthe ffdlll off 
1966 the system consisted of 47 separate institutions, tthirtmen off 
which were comprehensive community colleges offering college ttaaauxfax,, 
vocational, technical, and adult education programs. The neadliiiqg 
34 institutions were technical institutes offering ihe same fpxrgftmas 
as the community colleges except that they did not of fer cthe aodiLb^ge 
transfer program. These Institutions, in the fall of 1966. aanfllbH 
a full-time equivalency of 28,250 students, the majority <tff uHlirfh 
were enrolled in vocational and technical programs. 3 By tithe gtfUH aS 
1968 total enrollment had increased to a full-time eipilvdleany off 
45,902, of which 66 per cent who in occupational education. TThe iin- 
stltutlons then numbered fifty. 4 

Because of the rapid growth noted above and With aiffl hnrilr uqmp 
the development of quality in occupational programs, -the attote off 
North Carolina is an acknowledged leader in the field of <occifpctiiiondl 
education in the southeastern United States and has gained .« meuiioadl 
reputation because of its efforts, for these reasons it aw dhBlMrf 
to rely heavily upon the North Carolina system in the davti.1 ijpmtf orff 
achievement measures. This reliance included both students tto fibttse 
the tests and instructors to serve as subject-matter spedilkts ten 
the development of test outlines and the construction iff * fpodl off 
test items from which tests could be made. 

An additional reason for reliance upon the North (QatdliinB 
system was the presence of a veil-developed and well -organised 



1. Enrollment data obtained from Julian Wingfield, SegerrVJmar aS 
Statistical Service, N.C. Dept, of Comm. Colleges, Bdlnjgh, ?KCC. 

2. North Carolina, General Statutes of North Carolina , Chapter 

3. Wingfield, op. cit. 

4. Ibid. 



curriculum laboratory which has played a great role in the development 
c*f occupational curricula for implementation in the system. To this 
time the curriculum laboratory has developed curricula for approxi- 
mately 49 technical and 43 trade programs. 1 

In the development of occupational curricula for the North 
Carolina system, the curriculum laboratory relies upon (1) a well- 
trained staff of curriculum specialists, (2) Industrial representa- 
tives, and (3) administrators and instructors from institutions within 
the system. 

The procedure followed in the development of a new curriculum 
is as follows. Once the need for a particular program has been estab- 
lished (through local and/or state surveys), the curriculum laboratory 
appoints an advisory committee consisting of representatives of in- 
dustries which are potential employers, administrators from institu- 
tions which are likely to offer the new curriculum, and Instructors or 
other personnel who may have special knowledge of the problem. Repre- 
sentatives from industry include both management and labor and are 
chosen for their knowledge in the field. Oftentimes, representatives 
from the Employment Security Commission and the North Carolina Depart- 
ment of Labor also serve on the advisory committees. 

The advisory committee, working under the guidance of a curri- 
culum specialist, develops a basic curriculum for the program which 
includes general course descriptions and time allocation for various 
courses. Next, the curriculum laboratory examines the curriculum to 
make sure that the civic and liberal objectives as well as the techni- 
cal objectives are met. After revisions have been made, subject-matter 
specialists are called upon to develop course outlines and related in- 
structional materials. Finally, the curriculum is published for use 
in the system where the need for such a curriculum can be demonstrated. 

A block of courses which are considered to be either institu- 
tional or student electives is built into each curriculum. These 
electives, usually 10 to 20 per cent of the curriculum, may be used 
by a particular institution to develop courses to meet the needs of 
industries within their local service areas. 

B. CURRICULUM AREAS 

The selection of curricula for which achievement measures 
were developed was based mainly upon three criteria. The first criterion 
was the extent to which the curriculum laboratory of the North Carolina 
Department of Community Colleges and Technical Institutes had developed 
curriculum objectives, curriculum outlines, course objectives, course 
outlines, and related materials for a particular curriculum. The second 
criterion was the extent to which these developed curricula had been 



1. Technical and Trade Curriculums Manual . Curriculum Laboratory, 
N. C. Dept, of Community Colleges, Raleigh, N. C. 
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implemented throughout the system. The third criterion was gross system 
enrollment in a given curriculum. Using these criteria and considering 
the amount of work which could be accomplished with a given number of 
professional personnel and a fixed budget , seven curriculum areas , in- 
cluding two technologies and five trades, were selected for the develop- 
ment of achievement measures. The two technologies selected were (1) 
data processing and (2) electronics; the five trades were (1) air 
conditioning, heating, and refrigeration, (2) automotive mechanics, 

(3) electrical installation and maintenance, (4) machinist, and (5) radio 
and television servicing. 

C. TYPE OF SAMPLE 

Although, as noted above, the expertise of the North Carolina 
system was heavily relied upon, it was recognized by the staff that 
other states should be included in both the development of test in- 
struments and the sampling of students. It was further recognized that 
two distinct approaches to occupational training prevail in the various 
states. Some states place great emphasis upon occupational training 
at the high school level through comprehensive high schools or vocational- 
technical high schools. Other states (particularly in the South) have 
not been successful in implementing such programs at the high school 
level and have turned to post high school institutions to accomplish 
occupational training. Finally, a subdifference in the post high school 
category exists in that some states have post high school technical 
institutes which offer only occupational training, whereas some states 
have comprehensive community colleges which also offer college transfer, 
general and basic adult education. Some states even combine both 
approaches. 

It was decided by the project staff that each of the afore- 
mentioned approaches should be represented in the testing sample, but 
because of the heavy reliance upon post high school personnel, the 
prevalance of the post high school approach to occupational training in 
the South, and a limited budget, it was decided that the post high school 
approach would receive more emphasis. On this basis and for the initial 
testing effort conducted in the spring of 1967, all institutions offer- 
ing curricula in which achievement measures were developed in both the 
North Carolina system of technical institutes and community colleges 
and the South Carolina system of technical education centers were asked 
to participate. Also, all technical colleges and vocational-technical 
high schools in Connecticut were asked to participate. Additionally, 
an institution in California, one in Colorado, one in Wisconsin, 
several in Georgia, one in Delaware, and institutions in three counties 
in New Jersey were asked to participate in the initial effort. These 
additional institutions represented both high school and post high 
school approaches to occupational training. 

The institutions in California, Colorado, and Wisconsin de- 
clined to participate for various reasons. The Connecticut technical 
colleges agreed to participate, but the vocational-technical high schools 
declined on the grounds that they were already participating in a 
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similar testing effort being conducted by another university. On the 
basis of these contacts, the first year's testing included six states 
with the number of students and institutions indicated below.: 



State 


Institutions 


Students 


Connecticut 


4 


187 


Delaware 


1 


43 


Georgia 


1 


77 


New Jersey 


3 


121 


North Carolina 


31 


778 


South Carolina 


9 


378 


Total 


For the second year's 


testing, all participants 


t in the first 


year's effort were asked to participate. In addition, 


other insti- 


tutlons in Georgia, institutions in the Virginia community college 


system, and certain vocational 


-technical high schools 


in Pennsylvania 


were asked to participate. On 


this basis, the second 


year's testing 


sample was as follows: 


State 


Institutions 


Students 


Connecticut 


4 


170 


Delaware 


1 


55 


Georgia 


10 


341 


New Jersey 


2 


80 


North Carolina 


32 


696 


Pennsylvania 


2 


138 


South Carolina 




473 


Virginia 


1 


39 
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CHAPTER III 



PROCEDURES 



A. ADVISORY COMMITTEE 

To insure that the overall program design and plans for its 
implementation were sound, and to facilitate communication among both 
educators and researchers concerned with the goals of the investiga- 
tion, an advisory committee was formed. Members of this committee were 
selected specifically to represent both academic research interests 
and the interests of those more closely associated with the type of 
training that was the subject of the project investigations. The 
committee met periodically as a group during early stages of the re- 
search and individual members were consulted throughout the research 
on matters related to their field of specilization. Members of the 
committee were: 

Durwin M. Hanson, Professor and Head, Department of Industrial 
Education, North Carolina State University 

Joseph T. Nerden, Professor, Department of Industrial Education, 
North Carolina State University 

Monroe C. Neff, Assistant Director, North Carolina Department of 
Community Colleges, Head, Division of Vocational and Technical 
Education 

Ivan E. Valentine, Assistant Director, North Carolina Department 
of Community Colleges, Head, Division of Vocational and Technical 
Education 

Anthony J. Bevacqua, Coordinator of Curriculum Laboratory, North 
Carolina Department of Community Colleges 

William H. Denton, Guidance Specialist, North Carolina Department 
of Community Colleges 

Edward T. Brown, Supervisor of Research, North Carolina Department 
of Community Colleges 

B. CONSULTANTS 

In order to provide for a continuing assessment of the program 
by experts who were associated with neither the program nor the institu- 
tion in which the research would be conducted, a panel of consultants 
was established. The panel consisted of authorities in the fields of 
psychology, education, and test development. Members of the panel 
provided individual consultation throughout the course of the project. 
The following individuals served as consultants on the project: 
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Dr. Rupert N. Evans, Dean, College of Education 
University of Illinois 

Dr. Robert F. Lockman, American Psychological Association, 
Washington, D. C. 

Dr. Norman E. Stander, Research Psychologist, 

American Public Health Service, New York 

Dr. Jacob Stern, Associate Professor of Education 
Michigan State University 1 

Dr. Bert Westbrook, Associate Professor of Psychology, 

North Carolina State University 

C. PROJECT STAFF 

Project staff members were needed who had backgrounds In both a 
subject-matter area as well as psychological measurement of education. 
The various staff members were recruited from North Carolina State 
University and other educational Institutions. All members of the final 
staff had a background In either psychology or education, and at least 
one member had a background In each of the seven curricula. 

All staff members were provided an orientation to the various 
participating Institutions and with the curriculum laboratory. These 
orientation meetings aided In developing a close working relationship 
between the Institutions and provided insight Into the curriculum 
development. Each staff member was thus made more familiar with the 
areas In which the project would be working and was better able to 
coordinate the various activities of the item-writing committees, 
test administration, etc. 

D. ITEM-WRITING COMMITTEES 

Item-writing committees were formed for each subject-matter 
area for which an achievement test was to be constructed. Each 
committee consisted of five or six subject-matter specialists and at 
least one member of the project staff at North Carolina State Univer- 
sity who was familiar both with the subject matter and with the 
technical procedures of test development. These subject-matter 
specialists were Instructors In several of the Institutions In which 
testing was to be conducted, and were primarily from Institutions In 
North Carolina. However, In some Instances, instructors were in- 
cluded from institutions in other participating states to insure a 
broad perspective. 

It was important to insure that the most recent concepts within 
each field were covered by the tests. Therefore, only instructors who 
were currently engaged in teaching a given subject were used as subject- 
matter specialists. The fact that these instructors also attended 
workshops and institutes in their subject area aided in the development 
of comprehensive and current test instruments. 

^ow at the University of Illinois 
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E. ANALYSIS OF CONTENT UNITS 



Each of the instructors who was serving on an item-writing 
committee was visited, and the objectives and operating procedures 
of the research project were outlined. Using a curriculum developed 
by the North Carolina Curriculum Laboratory each instructor was 
asked to do a complete analysis of that portion of the curriculum 
that he considered his trade or technical specialty. When the analyses 
were completed, meetings were held with these instructors in each of 
the seven technical or trade curricula included in the project. One 
of the major purposes of these meetings was to arrive at a consensus 
concerning the curriculum analysis. 

When a consensus was reached, an outline was designed to serve 
as a guide in the development of the achievement tests. The final 
outline in each curriculum was subdivided into as many different areas 
as the committee members felt necessary to represent what they con- 
sidered to be independent areas of instruction. Each independent area 
was then further subdivided to detail the various elements of the 
curriculum contained therein. The breakdown was used to insure that 
items for each item-pool would be truly representative of all aspects 
of that curriculum. 

F. WEIGHTING OF CONTENT UNITS 

In developing achievement tests that were truly representative 
of the cognitive learning experience, it was recognized that the 
subject matter was covered in varying degrees. That is, a certain 
amount of time, is allocated to cover each aspect of the curriculum and 
an assessment of the resulting learning would have to reflect this 
emphasis. 

The members of each committee were asked to arrive at a 
mutually acceptable outline of the percentage of time they felt was 
devoted to each subdivision within the curriculum. This percentage 
allocation reflected the varying degrees of emphasis that were placed 
on teaching the different parts of the subject-matter area. Such an 
outline was used to develop a comprehensive pool of test items that 
was not only representative of the material covered, but also of the 
amount of time spent teaching each aspect of the material. 

G. LEVELS OF ITEM COMPLEXITY 

Aside from insuring that all phases of the curriculum would be 
examined, the need for a way of conceptualizing the objectives of the 
various programs in behavioral terms became increasingly apparent. At 
the most general level, such a conceptualization provided the educators 
with a means of focusing their attention on the psychological processes 
used by the students to learn the materal in each curriculum. 

The Taxonomy of Educational Objectives, The Classification of 
Educational Goals , Handbook I: Cognitive Domain (Bloom, et al.) was 
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examined since it represents the most elaborate attempt to use this 
basic approach. The project staff spent considerable time attempting 
to apply this system of classification to the curricula under study. 

It was found that considerable confusion existed among the industrial 
education teachers who were not familiar enough with education theory 
to use this system. It was therefore concluded that such a broad 
conceptulization of behavior was not a useful tool to provide subject- 
matter specialists. 

A system that was more easily understood and insured a coverage 
of the levels of cognitive functioning appropriate for the students to 
be tested, was therefore developed. It evolved from a modification of 
Bloom's Taxonomy and consisted of four levels of classification. These 
four levels are: Knowledge, Understanding, Application of Knowledge, 
and Application of Understanding. Operational definitions of these 
four levels were developed for use and are presented below. 

Knowledge Items of a test which measure knowledge require the 
repetition of responses that have been or should have been practiced 
in learning experiences prior to the time of taking the test. After 
learning, memory is the major requisite to correct performance. 

Understanding Items of a test which measure understanding 
require responses in addition to those previously practiced and learned. 
The additional responses are likely to be interpretations, translations, 
summarizations, analyses, detection of similarities, detection of 
differences, etc. Items at this level do not set tasks which require 
solutions other than explorations in meaning. 

Application of Knowledge Items of a test which measure 
application of knowledge require the use of previously learned responses 
in the solution of problems set by the items. At this level the problems 
are not new having been experienced by the testee before to the extent 
that responses that are necessary to find solutions are more or less 
routine. 



Application of Understanding Solutions to problems in application 
of understanding require responses of the understanding level. At least 
^.ne element of the problem is new to the testee. The newness might 
appear in either the conditions of the problem or in the solution re- 
quired; that is, a new, novel solution might be required. 

The various committee members met collectively several times 
to insure that all concerned with writing test items were in complete 
understanding of this classification system. Thus, when items were 
being written the instructors were aware that for each category on the 
curriculum outline the possibility existed that learning could be 
assessed at four conceptual levels. 




10 



H. ITEM GENERATION AND DEVELOPMENT 



When they were well acquainted with the behavioral taxonomy 
that was to be used, the various curriculum item-writing committees 
met to outline the procedures for building a test-item pool. Since 
each instructor had one or more areas which was considered his specialty, 
it was decided that the best approach was to have each man write actual 
test items which they felt would adequately measure the student's 
acquisition of all relevant material in that curriculum area. 

As the items were developed they were sent to the project 
staff. The items were then edited and evaluated in terms of grammati- 
cal correctness, format consistency, and adherence to accepted principles 
of test construction. The instructors wrote items in proportion to the 
degree of emphasis placed on the various subdivisions as agreed upon 
by the committees. 

The item pool for each curriculum area was reproduced in booklet 
form to aid in evaluation. The various committees met periodically 
during the first year to review the items with regard to both their 
adequacy in attempting to measure student learning and to decide at 
which level on the taxonomic hierarchy each item should be placed. 

Many such meetings occurred as the various item pools began approaching 
six to seven hundred items each. 

Each item was examined and discussed by the committee members. 
Only those that appeared to be satisfactory were actually chosen for 
Inclusion in the experimental forms of the tests. In most instances, 
the final pool of acceptable items for each curriculum area totaled 
over six hundred. 

I. DESIGN OF EXPERIMENTAL TESTS 

With a pool of items constructed to represent each topic into 
which each curriculum had been divided, and at the same time to be 
representative of the four different levels of learning agreed upon 
by the staff, the compilation of the tests was begun. In order to 
examine a maximum number of items, it was decided that two experimental 
forms of each test would be developed. 

The various item-writing committees compiled two separate tests 
from the pool of acceptable items. Aside from insuring that the tests 
reflected approximately the degree of emphasis depicted in the test 
specifications, special attention was devoted to the aspect of cognitive 
behavior measurement. That Ik., each content category of the specifica- 
tions received approximately the same number of knowledge items, under- 
standing items, etc. In this way each of the forms was made the parallel 
of the other. 

Tests in the two technologies and in the five trade areas were 
developed, reproduced, assembled, and made ready for administration. In 
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each of the seven curricula, with the exception of air conditioning, 
heating and refrigeration, two fonts of each paper and pencil test were 
developed. After such consideration, it was the opinion of the staff 
that in the air conditioning, heating and refrigeration curriculum 
insufficient test material was available to develop two forms of the 
test. Therefore, all efforts in that curriculum were devoted to the 
development of one fora of the test. 

J. DSE OF REFERENCE TESTS 

Much thought and discussion was directed toward the best 
methodology for the evaluation of data gathered during th,e administra- 
tion of the experimental achievement tests. It was decided that a 
complete item analysis for each item on each test should be done. This 
analysis included an evaluation of an item's relationship to the total 
score of the test, the total score on the subtest to which it belonged, 
and to all other suutests on the test. Item difficulty and effective- 
ness of distractors was also examined. A factor analysis was also done 
on each test in order to determine the actual ntnber of factors being 
measured. In order to identify the factors Isolated through factor 
analysis, it was decided that several short tests which measure rela- 
tively pure factors of intelligence should be administered along with 
the achievement tests. A thorough review of tests available led to 
the selection of a battery of research instruments titled "Reference 
Tests for Cognitive Factors." These tests were developed by Educa- 
tional Testing Service in cooperation with the U. S. Office of Naval 
Research. Some of the most reputable people in testing research 
participated in the development of the reference kit which was designed 
for use in research studies. Each test in the kit was designed to be 
as pure as possible a measure of a single factor in the cognitive area. 
The kit contained tests which measured twenty- four different cognitive 
factors, and the tests were relatively short, ranging from three to 
twenty minutes in length. The project staff, in consultation with 
subject-matter specialists and other consultants , selected from five to 
eight of these tests for administration with each of our achievement 
tests. Tests were selected based upon their expert judgment that the 
cognitive factors measured by the respective tests contributed to 
achievement in a given trade or technology. 

K. TEST ADMINISTRATION 

With the completion of the selection of various reference tests 
and with commitments from a number of institutions agreeing to partici- 
pate, plans were finalized for the initial test administration. A 
schedule was set up which allowed for two days to be spent at each 
school. This was necessary since the total testing time, i.e., achieve 
ment tests and reference tests, was six hours. Three hours were 
scheduled for each day. 

In the spring of 1967 administration was devoted almost ex- 
clusively to the electronics technology and data processing curricula 
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as the termination of two-year programs In these areas occurred at this 
time. Samples from the various states ranged from a very small percentage 
of the testable population to practically the entire testable population. 

The following procedure was used In administering the tests. 

Each curriculum area had two forms of the achievement test and several 
selected reference tests to be given. Half of the sample to be tested 
at each Institution received form A and the other half form B. The 
achievement tests were designed such that approximately half the test 
was given on one day and the remainder on the next. Students also took 
the reference tests, which were given In a specified sequence, for each 
curriculum. This equence was the rank order of judged Importance of 
the reference tests for the particular curriculum. In that way, If for 
some reason the administration of all reference tests was Impossible 
at a certain Institution, at least those reference tests given would be 
the ones deemed most Important. 

In certain Instances, It was found that some state's institutions 
were also having their trade curricula graduating at the end of the 
spring quarter. Therefore, provisions were made to examine these stu- 
dents at the same time that technology testing was being accomplished. 

Most of the spring trade testing was conducted in vocational-technical 
high schools in states which have separate post high school institutions 
for technical training. 

Scheduling for the majority of the trade testing was during the 
summer months. The vast majority of trade training in North and South 
Carolina is done on a four quarter, one year, post high school basis. 
Students enter in the fall and are graduated In late August. 

Test administration in the five trade areas was scheduled and 
conducted in much the same way as was testing In the two technologies. 

Two days were allotted us by each participating Institution, with three 
hours each day being devoted to the testing program. Both the achieve- 
ment tests and various reference tests for each curricula were adminis- 
tered; however, vocational students In many participating institutions 
were also scheduled to take various performance tests which were given 
at a different time. 

A number of institutions were able to schedule an additional 
three hours of testing time for the administration of the performance 
tests. These tests, which are described in detail in the Appendix, 
attempted to measure directly the level of noncognitive performance 
attained. The behaviors measured were psychomotor or perceptual be- 
haviors which were thought to contribute to a student's ability to 
perform the job for which he was being trained. 

In order to insure that the administration of these tests was 
the same for everyone sampled, testing teams were organized and staff 
members were assigned to one or more of the performance tests. The 
test administrators were thus able to become very familiar with the 
testCs) assigned them, insuring that subjects received the tests under 
standardized conditions. 
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Some of the more complex performance tests, i.e., automotive 
electric and diagnostic scope tests, the radio-television diagnostic 
test, etc,, were administered by Individuals who were technically 
competent In the area. This proved valuable In that the testipg (de- 
vices were not always In good operative condition due to the many 
miles that they had to be transported. Most of the time, a technical 
adjustment would render the set operative again. 

The performance tests were well received by both instructors 
and students. The latter were especially Interested In the ”doii\gf" 
aspect of these tests In that they were able to "work with their 
hands." 

L. EXPERIMENTAL TEST ANALYSIS 

The primary objective of this research was to develop (bests 
which were representative samplings of essential materials of the 
course of Instruction. The relationship between test performance and 
an external criterion of performance was not therefore a major con- 
sideration. As Is true of most achievement tests, the appropriate 
concept for validity In this project was content validity and this 
was Insured by the use of experts In the field of instruction as 
described earlier. 

All experimental pencil and paper achievement test scoring mas 
performed on an IBM-1230 test scoring machine, but all the reference 
tests and performance tests required hand scoring. Since each student 
generated from five to ten tests that required hand scoring, it is 
conservatively estimated that over ten thousand tests were hand scared. 

Analysis of the ' ta generated by the testing program was (done 
by computer. Computer analysis of the experimental tests included 
means and standard deviations for all subtests, all performance (bests, 
and all reference tests. Split half reliabilities, Item difficulty, 
biserial correlations for each Item, response count for each disticaclbar 
both above and below the mean were provided. Output also included 
subtest Intercorrelations for all subtests, performance, and reference 
tests. As this output was received, correlation matrices were nangpuitbed 
and factor analyzed. Test revisions were based on all this infcrmairtton. 

With the completion of the computer analysis, results were made 
available to each of the participating Institutions. The information 
presented Included: 

1. A raw score and a percentile score for each student Iby snkbestt. 

2. An Institution raw score mean and percentile mean for each 
subtest. 

3. Raw score means and standard deviations for the entire sanjple. 
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4. Raw score and percentile means, by subteal;, if or ecadh 
participating state. 

5. A profile chart which depicted the Institution' Is gmxffloelille 
standing by subject. 

6. An outline covering the test or tests taken U>y tthe satidteitte 
in a particular institution. 

All of the information was provided for both Form .A oar EB. thwHuHwH 

were the results of the performance tests, with eadh siUjjeuf oeaullts 
based upon the entire sample that took a particular cteat. BfajlidirO Bjtltgs 
of all of the achievement subtests, reference feats;, aand [peiffonaaicEe 
tests were also made available. 

M. TEST REVISION 

Based upon the analyses discussed above, aalegtitpp off ifcteans ffnr 
inclusion in the final form of each test was begun. SSevexdl nmeitbart; 
of the original item-writing committees were invited etc [pmrairi^prrte 
in the revision of the test for each curriculum. 

In general, items were selected that had high itviaorH rfl ga>- 
efficients and that had moderate difficulty indeces. Aha itfcem (Hffffijttilklyy 
of from .30 to .70 means that from JO to 70 per cent oaf ttfaame aairifattte 
answering the item got it correct. The most preferable a£jk£uai£bm warns 
to have high biserial correlations with difficulty HnHeeas -fin rtte 
moderate rather than extreme range. 

Most of the committees discovered that there .wore aramjgh litemne 
to meet these criteria so that additional new items yt«ere mot reegiibestl. 

In some cases a distractor bad to be rewritten, or the «±em <xS qpestiiinii 

reworded, but the majority of acceptable items ^required cud oeetfhGttmi. 

The committee working on the machinist test iBetillfaa tto tm e m HU ff- 
ate the Safety subtest into the other subtests, aelenting tffaaae items 
that were acceptable and applying them to the ether c onten t aaBttattte. 

This procedure was also followed by the automotive comniitttvt. 

The committee revising the air conditioning, I-beattqg aaaid mfinrfi— 
geration test decided to include those acceptable iitews CExnm tthe 
Fundamentals subtest in the other subtests where npp'Ucdtile.. TFhe tEadio- 
televlslon committee decided to reduce the number of niifat^cbs ffnam riiirae 
to seven, incorporating several concept areas into -hroaFter rrrbmri-fBim- 
tlons. 



The area that underwent the most extensive rre Vision wa® dints 
processing. Administration of the data processing ^ndtilfiweiB&xtt tfeeate 
revealed several preliminary weaknesses of the instruments. EHteett,, (the 
test used FORTRAN as the major programming language, ^hrffrifart rtverifan 
of the test in the various states revealed that some ifaMUbtflans une 
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COBOL as the primary language. Another veakness noted vas that the 
emphasis upon accounting was insufficient for the business majors 
while the emphasis upon mathematics was too hea>ry for them but appro- 
priate for the scientific majors. To remedy these weaknesses, a 
committee of data processing instructors from the various states 
sampled was formed. This committee had representatives from Connecticut, 
Georgia, North Carolina, and South Carolina technical education programs, 
and one member who was a computer programmer at the North Carolina State 
University Computing Center. It was the recommendation of this committee 
that separate subtests for business end scientific opcions be developed 
for mathematics and accounting and that subtests in both the FORTRAN and 
COBOL computer languages be developed to give each participating institu- 
tion a language option. These suggestions were accepted, and a major 
revision based on these recommendations was undertaken. 

All of the revised achievement tests were designed for a four- 
hour administration. Reference tests were not administered as part of 
the testing in the second year. 

N. STATISTICAL ANALYSES 

Results of a number of statistical analyses are reported in 
subsequent chapters for each test developed under this program. The 
following is a brief explanation of the statistical results reported 
and is provided so that the reader who is unfamiliar with them can 
interpret the results. The following references are also provided 
and will permit the reader to inquire in greater detail into the several 
concepts discussed. 

Ghiselli, Edwin B. Theory of Psychological Measurement , 

McGraw-Hill, New York: 196A 

Guilford, J. P. Psychometric Methods , McGraw-Hill, New York: 1954 

Harman, Harry H. Modern Factor Analysis , University of Chicago 

Press, Chicago: 1967 

Reliability The reliability of a test is an index of the 
consistency with which the test measures whatever it measures. In 
other words, will the test give the same results if used more than 
once? Vest reliability is usually expressed as a reliability (correlation) 
coefficient which can range from 0.0 to 1.0. Zero indicates that the test 
is totally unreliable and gives entirely different results on repeated 
use. A coefficient of 1.0 indicates that the test is perfectly reliable 
and gives exactly the same results on repeated use. 

Among the most common procedures for estimating the reliability 
of a test are "test-retest," the "alternate forms," and the "internal 
consistency" method. All three methods rely on detiving two sets of 
scores from the same teat administered to the same subjects for the 
purpose of obtaining a reliability coefficient. The "test-retest" 
method arrives at two scores by testing the subjects on two different 
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occasions. The score on the first administration of the test is 
correlated with the score on the second administration. Two parallel 
forms of the same test are administered to the subjects when the 
"alternate forms" method is used. Scores on these tests are then 
correlated. The "Internal consistency" method relies on one administra- 
tion of one form of the test and is thus economical in terms of adminis- 
tering time. The Kuder-Richardson method of internal consistency was 
used in this project since the assumptions underlying this method could 
be met easily. This method, which is really a series of formulas which 
vary in terms of the assumptions that can be made about the data, is 
based on the internal consistency of the test items. This approach 
allows the reliability estimate to be based on item statistics and at 
the same time hold computation to a minimum. 

Correlation Analysis The correlation between two variables 
(e.g., test scores or item scores) is a measure of the correlationship 
between them. The correlation is expressed as a coefficient ranging 
from -1.0 to +1.0. A coefficient of -1.0 signifies a perfect negative 
correlation and exiuts when two variables are inversly proportional, 
i.e., when the value of one variable Increases, the value of the other 
decreases proportionally. A coefficient of +1.0 Indicates a perfect 
positive correlation and exists when two variables are directly 
proportional, i.e., when one variable increases, the other increases 
proportionally. Zero correlation exists when there is no relation 
between the two variables. 

Correlation coefficients are often grouped together in a 
matrix which presents all possible Intercorrelations between the 
several variables. Usually only one-half of the matrix is presented 
since the correlation between variable X and variable Y is equal to 
that between variable Y and variable X. Elements on the main diagonal 
are sometimes omitted as the correlation of a variable with itself 
is +1.0. 



Factor Analysis The correlation matrix is the first step in 
factor analysis. Once a correlation matrix has been computed, it is 
sometimes desirable to investigate the underlying dimensions which the 
variables in the matrix have in common. Often the variables may over- 
lap with two or more variables measuring the same attribute while 
others mAy be measuring attributes which Are entirely separate. The 
purpose of factor analysis is to break down the correlation matrix 
into the separate dimensions or factors which represent the attributes 
measured by the original variables. 

The factor matrix is composed of rows equal to the number of 
variables and columns equal to the number of extracted factors. The 
coefficients or factor loadings range from -1.0 to +1.0 and represent 
the correlation between the variable and the particular factor. The 
variables can be identified with the factors by inspecting the factor 
loadings. All variables with large loadings on a factor can be 
identified as measuring the attribute represented by the factor in 
question. The commonality, (h 2 ), is an indication of the proportion 
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of variance which a given variable has in common with other tests in 
the battery. 

Skewness and Kurtosis The normal frequency distribution of 
scores is one which is symetrical with most scores falling in the 
middle of the scale around the mean. Fewer and fewer scores are found 
as the distance from the central point is increased with very few 
extremely low and high scores. A skewed distribution is one in which 
the highest frequency of scores is not in the center of the distribu- 
tion but lies to the right or left. This type of distribution could 
result from an overly-easy or difficult test where most individuals 
received either high or low scores. The degree of skewness is expressed 
as coefficient of skewness. A coefficient of rero represents a 
symetrical distribution. Positive coefficients indicate that the 
highest frequency of scores fall in the lower range to the left of 
the central region of the scale. Negative coefficients indicate that 
the largest frequency of scores fall in the upper region of the scale. 

Kurtosis refers to the degree of "flatness" of the frequency 
distribution. Flatness results when the scores are spread out evenly 
over the entl-e range. When a distribution is "flatter" than normal 
it is termed platykurtlc. A leptokurtic frequency distribution! on 
the other hand, is one in which the scores tend to pile up in one 
region of the scale resulting in a more "peaked" curve than normal. 

The coefficient of kurtosis ranges from high positive values, indica- 
tion a leptokurtic distribution, to high negative values representing 
a platykurtlc distribution. A normal distribution has a coefficient 
of kurtosis equal to zero. 

Norms Test scores have more meaning if they are referenced 
to the distribution of scores earned by a number of individuals. This 
referencing is accomplished by sampling the population of Individuals 
for which the test was prepared. Test scores from this sample are 
analyzed and the mean, or measure of central tendency, and variance 
or spread of the scores, are computed. An individual's test score can 
then be compared to the results of this information. The adequacy of 
the norms is dependent on the number of cases involved and the re- 
presentativeness of the sample to the total population selected. 

Test scores that are referenced to a distribution of scores 
are usually reported in percentile rank or standard scores. The per- 
centile rank of a score is the percentage of persons in the reference 
group who earn lover scores. Therefore, if a person falls at the 70th 
percentile, he has scored better than 70 per cent of the people taking 
the test. 

Standard scores are baaed on mathematical characteristics of 
the distribution— the mean and standard deviation. The mean of the 
distribution is a measure of the central tendency and is equal to the 
sum of the individual scores divided by the number of scores. The 
standard deviation of a distribution is a measure of the spread of 
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scores about the mean. A distribution, therefore, can be described by 
its mean and standard deviation. Raw scores can be transformed to a 
new distribution with a known mean and standard deviation. One s 1 ' .*» 
transformed distribution has a mean of 500 and a standard device* rt of 
100. It is this distribution that was used for tests reported i~ this 
report. 
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CHAPTER IV 



DATA PROCESSING 



A. EXPERIMENTAL TESTS 

Tables IV-1 through IV-S present test specifications, descrip- 
tions of the sample and detailed psychometric characteristics for the 
experimental Data Processing tests. Table IV-1, Test Specifications, 
presents the breakdown of course content which the item-writing committee 
developed. This table indicates the number of items considered necessary 
to sample each content area and also reflects the level of cognition 
necessary to master the particular content, l.e., knowledge, understand- 
ing, application of knowledge, or application of understanding. It 
should be noted that the number of items in both the experimental and 
final tests do not necessarily correspond to those in the table. The 
same relative emphasis was maintained in both forms of the test however. 
It should also be noted that subtests do not always correspond to major 
headings of the outline since other considerations were taken into 
account in grouping items into subtests. 

Samples from the various states, reflected in Table 1V-2, range 
from a very small percentage of the testable population to practically 
the entire testable population. In the states of Connecticut, North 
Carolina, a* J South Carolina practically all students scheduled to 
graduate at the end of the spring quarter or semester were tested. In 
North Carolina two of the four institutions offering Data Processing 
graduated their students at the end of the winter quarter. Since the 
achievement tests were not ready for administration at that time, over 
half of the testable sample was lost in that state. 

From Table IV-3 it can be seen that reliabilities of experi- 
mental subtests range from .54 to .79. Tables 1V-4 and IV-5 present 
the Intercorrelations and factor analysis results for form A and B 
respectively. It can be seen that factor 1, which accounts for 27 
per cent of the common variance, explains most of the correlation among 
the achievement subtests. Subtest 1, Systems Concepts, and Subtest II, 
Applications, have high loadings on factor 1 while Subcest III, Mathe- 
matics and Statistics, and the Ship Destination and Symbol Production 
reference test, have moderate loadings on this factor. Subtest III and 
IV have their highest loadings on factor 4 and none of the reference 
tests have high loadings on this factor. The distinction between 
factors 1 and 4 appears to be that factor 1 is more related to the 
logic Involved in data processing while factor 4 is more quantitative 
in nature, although this is not supported as strongly by reference 
test loadings as would be expected. 

The factor analysis of form B shows that factor 1 does not 
measure achievement in Data Processing. Factor 2, which accounts for 




21 



approximately 22 per cent of the variance , appears to explain most of 
the correlation among the achievement subtests. This factor appears to 
be the same as factor 1 for form A. None of the reference tests load 
on factor 2. Factor 4, which accounts for 16 per cent of the variance, 
again appears to be a quantitative factor with a high loading on Subtest 
IV, Accounting, and high loadings on the reference test Subtraction- 
Multiplication and Number Comparison. The two analyses agree fairly 
closely, the major difference being that Subtest III has its highest 
loading on the numerical factor in form A whereas it has its highest 
loading on the logic factor in form B. 

B. FINAL TEST 

The description of the sample for the Data Processing-Scientific 
and Business tests are presented in Tables IV-6 and IV-7. Psychometric 
characteristics of these tests are presented in Tables IV-8 through IV-11. 
It can be seen from Table IV-8 that the Data Processing-Scientific 
subtests have reliabilities ranging from .62 to .95, with a total test 
reliability of .97. It can also be seen from this table that skewness is 
negligible for all the subtests, although Subtest II and the total 
test are somewhat platykurtic. From the Intercorrelations in Table IV-9 
it can be seen that the tests share about the same degree of common 
variance and only one common factor appears to be measured by these 
subtests. (Factor analyses were not computed for final tests since no 
reference tests were administered.) 

It catt be seen from Table IV-10 that reliabilities for the Data 
Processing-Business range from .66 to .88 for subtests with a total test 
reliability of .92. It can also be seen that Subtest II* Programming 
Language, is negatively skewed and considerably leptokurtlc, as is the 
total test. A comparison of Table IV-11 with Table IV-9 shows that 
the intercorrelations among the subtests for Data Processing-Business 
are more heterogeneous than for Data Processing-Scientific. For example, 
the relationship between achievement on Subtest I and III for Business 
students was not nearly as strong as it was for Scientific students. 

Norms for concerting raw scores to percentiles, and standard 
scores with a mean of 500 and a standard deviation of 100, are pre- 
sented in Table IV-12 for subtests and Table IV-13 for total test scores 
for Data Processing-Business, and in Tables IV-14 and IV-15 for Data 
Processing-Scientif ic. 
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Table IV-1 
DATA PROCESSING 
Test Specifications 



CURRICULUM CONTENT AREA 



K 



U 



A 



u 



I. DATA PROCESSING SYSTEMS CONCEPTS 



A. 


Computer language and program aids 










1. FORTRAN 


6 


2 


3 




2. COBOL 


3 








3. Symbolic 


4 


4 






4. Programming aids 


3 


1 


1 




5. Machine language 


1 


4 




B. 


Unit record 


12 


9 




C. 


Input/output 


8 


5 






1. Tape (paper and mag) 


6 


1 






2. Card 


11 








3. Printer 


10 


4 


1 




4. Magnetic Ink character recognition 


3 








5. Optic devices 


1 


1 




D. 


Memory 


3 


5 






1. Core 


1 


1 






2. Disc 


1 


1 






3> Drum 




1 




E. 


Computer loplc 


1 


3 






1. High/low, equal, compare 


2 


1 






2. Sense switch 








F. 


Arithmetic unit 


2 








1. Tables 










2. Registers 


1 






G. 


History and development 


7 






MATHEMATICS 








A. 


Algebra 










1. Basic algebra 




12 


1 




2. Linear equations 




6 


3 




3. Matrix theory 


3 


3 


4 




4. Quadratics 


1 




3 


B. 


Numbering systems 










1. Conversion (current systems) 


1 




7 




2. Operations 






7 


C. 


Statistics 










1. Measurement of central tendency 










and dispersion 


2 


2 






2. Correlation 


1 


2 






3. Test of hypothesis (X 2 , t-test, 










ANOV) 




1 


3 


D. 


Logical math 










1. Boolean expressions 






1 




2. Logic diagrams and circuits 






2 




3. Truth tables 




1 




E. 


Trigonometry 




2 


5 


F. 


Geometry 


2 


1 


1 
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III. APPLICATIONS 



A. 


Accounting 


1 




1. 


Payroll 






2. 


Sub-ledger 8 (AR&P, Inventory 


2 


B. 


Scientific Managenent 


1 




1. 


Linear programming and critical path 


1 




2. 


Real-time 


1 




3. 


Tele-processing 






4 > 


Hultl-processing 




C. 


Statistics 


13 




1. 


Data analysis 






2. 


Probability 




D. 


Systems and procedures 






1. 


Total system concept- 






2. 


Feasibility study 






3. 


Decision tables 


1 


ACCOUNTING 




A. 


Cost accounting 






1. 


Cost systens-Job, process and 
standard 


3 




2. 


Elements of cost - material, 
labor, and overhead 






3. 


Inventories - FIFO, LIFO, and average 


2 




4. 


Variance analysis 





B. Corporation accounting 

1. Financial statements - balance sheet. 



P & L, and capital 3 

2. Assets - ledger accounts 2 

3. Liabilities - ledger accounts 

A. Capital - ledger accounts 4 

5. Ratios - ledger accounts 1 

C. Proprietorship 

1. Accounting equation - A * L+P 2 

2. Accounting cycle 

a. Account 3 

b. Trial balance 

c. Journal and ledgers 1 

d. Periodic summary 1 

D. Partnership 

1. Voucher system 1 

2. Payroll 

3. Taxes 

4. Capital structure - partnership 

vs corporation 2 



1 

1 1 
8 

8 2 
1 



2 



6 

1 1 

3 

1 

3 

2 

1 

3 
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Table 1Y-2 



DATA PROCESSING 
First Tear 



Description of Sample 



State 


Ho. of Institutions 


No. of Students 


Connecticut 


4 


73 


Georgia 


1 


16 


North Carolina 


17 


44 


South Carolina 


6 


46 



28 179 



Table IV-3 

DATA PROCESSING 
Experimental Tests 

Description and Reliabilities 




Subtest 


Time 

Limit 

(min) 


Form A 


Form B 


Form A 


Form B 


I 


Data Processing Sysu 














Concepts 


50 


60 


60 


.73 


.79 


II 


Data Processing Syst< 














Applications 


90 


60 


60 


.72 


.79 


III 


Mathematics and Statistics 75 


so 


50 


.76 


.65 


IV 


Accounting 


25 


30 


30 


.65 


.54 




Total 


240 


200 


200 
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00 
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so 
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CO 


vO 
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no 


co 


O 


00 


O* 


O 


CO 


CM 


00 


CM 


no 




CM 


o 


'O 
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r-l 


r-l 


o 


r-l 
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CM 


co 


vO 


CM 


rH 


CM 


CM 


00 


<* 




CO 


vO 


CO 


•H 


CM 


O 


CM 


rH 


vO 


O 


co 


r-l 


CO 


CM 




1 




1 




1 














CM 




00 


vO 


r-t 


St 


O 


O 


CO 


Os 




3 




CM 


? 


CM 


iH 


vO 


O 


00 


r-l 




M 


r -4 


CM 


00 


CM 


M 


«H 


M 


CO 


Os 


r-l 


CO 












r-l 


st 


CO 


? 


? 


? 


CO 


<* 


dS 


■H 


n 0 


rH 




CM 


sO 


r-l 


CO 


CM 


uo 


l 


CM 


CM 


CM 


fH 


CM 


r-l 


o 


rH 


CM 


I 


an 


.H 


rH 


CM 


CO 


CM 


iH 


& 




<t 


1 




CM 


CM 


CO 


O 


CM 


f-A 


CM 


CM 


1 




JUI 


18 


3 


Ov 

CM 


18 


MO 

4 


15 


45 


19 


1 






ON 


CO 


*0 


O 


CO 


M 


sO 


00 


1 








? 


iH 


rH 


•H 


? 


4 


r-l 


I 








AW 


CO 




»A 


no 


M 


CM 


I 










CM 


O 


CM 


CM 


CO 


O 


1 










HS 


00 


O 


CO 




CO 


1 












iH 


co 


CM 


CM 


CM 


V 












QMS 


36 


18 


23 


04 


1 














At 


27 


19 




1 
















in 


46 


32 


1 
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o o 

<M O 
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CM O 
<M 00 
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Table IV-6 



DATA PROCESS INC - BUSINESS 
Second Year 



Description of Saople 



State 


No. of Institutions 


'No. otff iBtrihttte 


Connecticut 


2 


112 


Georgia 


1 


IIS 


South Carolina 


7 


4© 




7 


773 



Table IV-7 

DATA PROCESSING -SCIENTIFIC 
Second Year 

Description of Saaple 


State 


No. of Institutions 


No. dt£f gtahittB 


Connecticut 


4 


36 


North Carolina 


2 


112 


Pennsylvania 


2 


36 




8 


H24 



28 




DATA PROCESSING-SCIENTIFIC 



00 

0 

•H 

U 

03 

•H 

M 

01 
4J 

a 

cd 

M 

cd 

x: 
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cd 
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M to 
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O 

U 
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to 



•H <fr 
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• a; 
o u 
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•H *rj *rl *rl *rf 

b b b b b 
o o o o o 

^ V0 (O O CO 



o o m o o 

VO CVJ ^ st 





XI 
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to 
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03 


♦ 












0 


iH 












01 


to 












4J 


to 






rH 






03 


c 






cd 














u 






CO 


• 






01 








00 






rs 






00 


a 






Cl 






a 


cd 






o 






•H 










4J 




0) 








1 


03 




03 


00 




03 




01 




01 


a 


03 


o 


00 4J 


4J 


o 




O 


*H 


a 




03 


o 


s 


•H 


4J 


*H 


rH 


01 


H 


P 


4J 


cd 


4J 


cd 


4J 


to 


cd 


03 


B 


a 


4J 


O 




u 


*H 


01 


3 


0 


D 


cd 


w 


<U 


X 


O 


H 


CO 


4~> 


o 


cd 


4J 


o 






cd 


M 
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Q 


to 


CO 


X 
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43 
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> 


VD N CO 
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IV 
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M 


o I 




M 


vo vo 1 




M 






M 


O 1 




H 


00 I 




W 


1 

1 




4J 






03 


w 




01 


M M > 




U 


M M M M > 




jq 






2 






CO 





29 




Decimals omitted 



DATA PROCESSING-BUSINESS 



w 

o 

•H 



03 
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U 

0) 

4J 

O 4-1 
Ctf 03 
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CJ H 
03 

o a 
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03 
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CO 
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CO 
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po 


*H 






2 
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HI 


03 






CO 


H 
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C3 


4J 
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1 
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M 
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H 
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*Part-whole correlations 
Decimals omitted 



Table IV-12 



RAW SCORE CONVERSIONS 
DATA PROCESSING - BUSINESS SUBTESTS 



Raw 

Score 




1 




2 




3 




4 




5 




6 


*Ue 


' stT. 

Score 


tile 


JtJT 

Score 


Zlle 


Std. 

Score 


tile 


Std. 

Score 


tile 


Std. 

Score 


tile 


std. 

Score 


55 


99 


690 






















54 


99 


682 


99 


667 


















5 J 


99 


674 


99 


662 


















52 


99 


667 


99 


656 


















51 


99 


659 


97 


651 


















50 


97 


651 


97 


646 


















49 


96 


644 


96 


640 


















48 


95 


636 


96 


635 


















47 


93 


628 


96 


629 


















46 


90 


620 


95 


624 


















45 


88 


613 


92 


619 


















44 


65 


605 


69 


613 


















43 


82 


597 


85 


608 


















42 


79 


589 


79 


602 


















41 


75 


582 


78 


597 


















40 


71 


574 


75 


591 


















39 


63 


5b6 


74 


586 


















38 


63 


558 


71 


581 


















37 


60 


551 


68 


575 


















36 


55 


54 3 


64 


570 


















35 


55 


535 


62 


564 










99 


772 






34 


53 


528 


58 


559 










99 


758 






33 


51 


520 


56 


554 










97 


745 






32 


49 


512 


55 


548 










97 


731 






31 


48 


504 


53 


543 










97 


ni 






30 


47 


497 


52 


537 










97 


703 






29 


45 


489 


49 


532 










97 


689 






23 


44 


481 


49 


527 










97 


676 






27 


42 


473 


48 


521 










97 


662 






26 


42 


466 


48 


516 










96 


648 






25 


42 


458 


47 


510 










95 


634 






24 


41 


450 


45 


505 










88 


620 






23 


41 


442 


45 


500 










86 


607 






22 


40 


435 


45 


494 










78 


593 






21 


37 


427 


45 


489 










75 


579 






20 


34 


419 


45 


483 










71 


565 






19 


34 


412 


45 


478 










70 


551 


99 


740 


18 


27 


404 


45 


473 










6 ? 


538 


98 


716 


17 


27 


396 


45 


467 










64 


524 


97 


693 


16 


23 


388 


4> 


462 






99 


814 


59 


510 


97 


69C 


15 


15 


381 


45 


456 


$9 


848 


99 


782 


56 


496 


93 


647 


14 


8 


373 


45 


451 


99 


810 


99 


749 


52 


482 


93 


624 


13 


8 


365 


45 


445 


99 


773 


97 


716 


48 


469 


80 


600 


12 


7 


357 


45 


440 


97 


735 


96 


683 


41 


455 


7/ 


577 


11 


4 


350 


45 


435 


96 


697 


92 


650 


37 


441 


72 


554 


10 


1 


342 


45 


429 


94 


659 


89 


618 


33 


427 


60 


531 


a 






45 


424 


93 


621 


86 


585 


26 


413 


58 


508 


8 






44 


418 


89 


584 


78 


552 


19 


400 


53 


485 


7 






42 


413 


77 


646 


68 


519 


11 


386 


42 


461 


6 






41 


408 


66 


508 


60 


487 


7 


372 


37 


438 


5 






38 


402 


55 


470 


47 


454 


7 


358 


27 


415 


4 






34 


397 


28 


432 


25 


421 


4 


344 


25 


392 


3 






26 


391 


17 


395 


U 


388 


3 


331 


12 


369 


2 






14 


386 


8 


357 


7 


355 






3 


345 


l 






l 


381 


3 


319 


3 


323 






2 


322 



31 




Table IV— 1 3 



RAW SCORE CONVERSION 
DATA PROCESSING - BUSINESS TOTAL TEST 



Raw 

Score 


me 


Std. 

Score 


Raw 

Score 


me 


Std. 

Score 


Raw 

Score 


Ule 


Std, 

Score 


Raw 

Score 


Xile 


Std, 

Score 


193 


99 


754 


140 


92 


626 


87 


47 


498 


34 


3 


370 


192 


99 


751 


139 


92 


623 


86 


47 


495 


33 


3 


367 


191 


99 


749 


138 


92 


621 


85 


47 


493 


32 


1 


365 


190 


99 


747 


137 


92 


619 


84 


47 


490 








189 


99 


744 


] 36 


90 


616 


83 


45 


486 








18$ 


99 


742 


135 


88 


614 


82 


44 


486 








187 


99 


739 


134 


86 


611 


81 


44 


483 








186 


99 


737 


133 


86 


609 


80 


44 


481 








185 


99 


735 


132 


86 


606 


79 


44 


478 








184 


99 


732 


131 


85 


604 


78 


44 


476 








183 


99 


730 


130 


85 


602 


77 


44 


474 








1S2 


99 


727 


129 


85 


595 


76 


44 


471 








181 


99 


725 


128 


82 


597 


75 


44 


469 








1B0 


99 


722 


127 


81 


594 


74 


44 


466 








179 


99 


720 


126 


79 


592 


73 


44 


464 








178 


99 


718 


125 


78 


590 


72 


44 


461 








177 


99 


715 


124 


77 


587 


71 


44 


459 








176 


99 


713 


123 


74 


585 


70 


44 


457 








175 


99 


710 


122 


73 


582 


69 


44 


454 








174 


99 


708 


121 


71 


580 


66 


44 


452 








173 


99 


706 


120 


70 


577 


67 


44 


449 








172 


99 


703 


119 


68 


575 


66 


44 


447 








171 


99 


701 


118 


68 


573 


65 


44 


445 








170 


99 


698 


117 


67 


570 


64 


44 


442 








169 


99 


696 


116 


67 


568 


63 


44 


440 








168 


99 


693 


115 


64 


565 


62 


44 


437 








167 


99 


691 


114 


64 


563 


61 


44 


435 








166 


99 


689 


113 


64 


561 


60 


42 


432 








165 


99 


686 


112 


62 


558 


59 


42 


430 








164 


99 


684 


111 


62 


556 


58 


41 


428 








163 


99 


681 


110 


60 


553 


57 


41 


425 








162 


99 


679 


109 


60 


551 


56 


38 


423 








161 


99 


677 


108 


60 


548 


55 


37 


420 








160 


99 


674 


107 


60 


546 


54 


36 


418 








159 


99 


672 


106 


59 


544 


53 


34 


415 








158 


99 


669 


105 


59 


541 


52 


33 


413 








157 


99 


667 


104 


59 


539 


51 


33 


411 








156 


99 


664 


103 


58 


536 


50 


30 


408 








155 


99 


662 


102 


56 


534 


49 


29 


406 








154 


96 


660 


1C1 


53 


532 


48 


28 


403 








153 


96 


657 


100 


53 


529 


47 


27 


401 








152 


95 


655 


99 


52 


527 


46 


25 


399 








151 


95 


652 


98 


51 


524 


45 


25 


396 








150 


95 


650 


97 


51 


522 


44 


23 


394 








149 


95 


648 


96 


51 


519 


43 


19 


391 








148 


95 


645 


95 


49 


517 


42 


19 


389 








147 


95 


643 


94 


49 


515 


41 


18 


386 








146 


95 


640 


93 


49 


512 


40 


14 


384 








145 


95 


638 


92 


48 


510 


39 


10 


382 








144 


95 


635 


91 


47 


507 


38 


8 


379 








143 


95 


633 


90 


47 


565 


37 


7 


377 








142 


95 


631 


89 


47 


503 


36 


7 


374 








141 


93 


6?a 


88 


47 


500 


35 


7 


372 









32 



0 

ER JC 

hfliflaffHMiaaa 



Table 1V-14 



RAW SCORE CONVERSIONS 
DATA PROCESSING - SCIENTIFIC SUBTESTS 



Raw 

Score 


1 






2 




J 




4 




5 


XI le 


std . 

Score 


X \ le 


Std, 

Score 


*lle 


Std. 

Score 


Ule 


Std. 

Score 


Xilc 


Std. 

Score 


59 


99 


715 


















58 


99 


706 


















57 


99 


698 


















56 


99 


690 


99 


687 














55 


99 


682 


99 


680 














54 


99 


674 


98 


673 














53 


99 


666 


98 


667 














52 


93 


658 


98 


660 














51 


97 


649 


98 


653 














50 


95 


641 


96 


646 














49 


94 


633 


94 


639 














48 


92 


625 


91 


623 














47 


90 


617 


87 


625 














46 


87 


609 


86 


618 














45 


83 


CO 


85 


611 














44 


78 


592 


85 


604 














43 


77 


584 


82 


597 














42 


73 


576 


79 


590 














41 


69 


568 


75 


583 














40 


69 


560 


72 


576 














39 


65 


551 


66 


569 














38 


65 


543 


63 


562 














37 


60 


535 


60 


555 














36 


57 


527 


59 


549 














35 


56 


519 


57 


542 














34 


53 


5H 


57 


535 














33 


52 


503 


56 


528 














32 


47 


494 


54 


521 














31 


43 


486 


53 


514 














30 


40 


478 


53 


507 














29 


39 


470 


53 


500 














28 


38 


462 


50 


493 










99 


718 


27 


36 


454 


49 


486 










98 


702 


26 


32 


445 


48 


479 










98 


688 


25 


32 


437 


46 


472 










96 


574 


24 


27 


429 


44 


465 










93 


549 


23 


23 


421 


44 


458 










89 


644 


22 


19 


413 


41 


451 






99 


744 


89 


629 


21 


18 


405 


40 


444 






99 


724 


89 


G15 


20 


18 


396 


38 


437 






93 


704 


81 


600 


19 


18 


388 


36 


431 






96 


684 


75 


585 


18 


18 


380 


30 


424 






95 


664 


74 


570 


17 


14 


372 


27 


417 






93 


644 


72 


556 


16 


12 


364 


24 


410 






88 


624 


67 


541 


15 


19 


356 


21 


403 






85 


604 


63 


526 


14 


10 


347 


17 


396 






00 


584 


63 


511 


13 


8 


339 


15 


389 


99 


706 


75 


564 


56 


497 


12 


8 


331 


15 


382 


97 


672 


72 


544 


51 


482 


11 


6 


323 


15 


375 


92 


639 


66 


524 


49 


467 


10 


3 


315 


11 


368 


89 


605 


60 


504 


46 


452 


9 


2 


307 


8 


361 


80 


571 


55 


483 


35 


438 


8 


2 


299 


6 


354 


70 


537 


42 


463 


30 


423 


? 


1 


290 


5 


347 


55 


503 


32 


443 


19 


408 


6 


1 


282 


4 


340 


45 


469 


24 


423 


14 


393 


5 


1 


274 


3 


333 


34 


436 


20 


403 


7 


379 


4 


1 


266 


2 


326 


25 


402 


14 


333 


7 


364 


3 






2 


319 


14 


368 


11 


363 


55 


349 


2 






2 


313 


8 


334 


9 


343 


5 


334 


1 










1 


300 


4 


323 


4 


320 



31 



o 
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Table IV-15 
RAW SCORE CONVERSIONS 
DATA PROCESSING - SCIENTIFIC TOTAL TEST 



Raw 

Score 


%ile 


Std. 

Score 


Raw 

Score 


%ile 


Std. 

Score 


Raw 

Score 


%ile 


Std. 

Score 


142 


99 


698 


98 


66 


560 


54 


24 


421 


141 


99 


695 


97 


66 


557 


53 


23 


418 


140 


99 


692 


96 


64 


553 


52 


23 


415 


139 


99 


689 


95 


61 


550 


51 


21 


411 


138 


99 


686 


94 


61 


547 


50 


20 


408 


137 


99 


683 


93 


61 


544 


49 


20 


405 


136 


99 


680 


92 


60 


541 


48 


20 


402 


135 


98 


676 


91 


57 


538 


47 


20 


399 


134 


98 


673 


90 


56 


534 


46 


19 


396 


133 


98 


670 


89 


55 


531 


45 


19 


392 


132 


98 


667 


88 


54 


528 


44 


19 


389 


131 


98 


664 


87 


53 


525 


43 


19 


386 


130 


98 


661 


86 


53 


522 


42 


18 


383 


129 


98 


657 


85 


52 


519 


41 


18 


380 


128 


98 


654 


84 


52 


516 


40 


15 


377 


127 


96 


651 


83 


50 


512 


39 


15 


374 


126 


95 


648 


82 


50 


509 


38 


14 


370 


125 


95 


645 


81 


49 


506 


37 


14 


367 


124 


95 


642 


80 


47 


503 


36 


13 


364 


123 


95 


639 


79 


47 


500 


35 


12 


361 


122 


95 


635 


78 


47 


497 


34 


11 


358 


121 


92 


632 


77 


42 


493 


33 


10 


355 


120 


92 


629 


76 


40 


490 


32 


8 


351 


119 


92 


626 


75 


40 


487 


31 


8 


348 


118 


91 


623 


74 


40 


484 


30 


8 


345 


117 


91 


620 


73 


40 


481 


29 


8 


342 


116 


89 


616 


72 


40 


478 


28 


7 


339 


115 


88 


613 


71 


40 


475 


27 


6 


336 


114 


86 


610 


70 


40 


471 


26 


6 


333 


113 


86 


607 


69 


39 


468 


25 


6 


329 


112 


84 


604 


68 


38 


465 


24 


5 


326 


111 


84 


601 


67 


37 


462 


23 


5 


323 


110 


82 


598 


66 


37 


459 


22 


4 


320 


109 


82 


594 


65 


37 


456 


21 


4 


317 


108 


80 


591 


64 


35 


452 


20 


4 


314 


107 


89 


588 


63 


33 


449 


19 


4 


310 


106 


79 


585 


62 


31 


446 


18 


4 


307 


105 


78 


582 


61 


31 


443 


17 


3 


304 


104 


76 


579 


60 


31 


440 


16 


2 


301 


103 


76 


575 


59 


30 


437 


15 


2 


298 


102 


73 


572 


58 


30 


433 


14 


2 


295 


101 


71 


569 


57 


27 


430 








100 


69 


566 


56 


25 


427 








99 


67 


563 


55 


24 


424 
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CHAPTER V 



ELECTRONICS 



A. EXPERIMENTAL TESTS 

Tables V-l through V-5 present test specifications, descriptions 
of the sample, and psychometric characteristics of the experimental 
Electronics tests. These tests were administered to a total of 338 
students during the first year and 327 during the second year in five 
different states. The majority of the students were completing a two- 
year post high school training program in community colleges or technical 
institutes in Connecticut, Georgia, North Carolina, and South Carolina. 

In addition to these institutions, two vocational-technical high schools 
in Pennsylvania also participated in this testing. 

From Table V-3 it can be seen that reliabilities of the experi- 
mental subtests range from .56 to .83. Table V-4 presents the inter- 
correlations and factor analysis for form A of the experimental tests. 
High loadings for all achievement tests are found on factor 1, which 
accounts for 59 per cent of the common variance. As no reference tests 
have significant loadings on factor 1, it can be concluded that this 
factor is measuring achievement in Electronics Technology and is in- 
dependent of the dimensions measured by the reference tests. 

Table V-5 presents the intercorrelations and factor analysis for 
form B of the experimental tests. All subtests have high loadings on 
factor 1, which accounts for 65 per cent of the common variance. No 
reference tests load on this factor, indicating that the factor under- 
lies achievement in Electronics Technology. Analyses for form A and 
form B agree fairly closely. 

B. FINAL TEST 

Tables V-6 through V-8 present the description of the sample, 
the psychometric characteristics, and the intercorrelations for the final 
tests. The reliabilities range from ,76 to .86 for the subtests with a 
reliability of .96 for the total test. From the same table it can be 
seen that the distributions for the subtests are slightly skewed and 
slightly platykurtic. The intercorrelations in Table V-8 indicate that 
the subtests share about the same degree of common variance. 

Norms for converting raw scores to percentiles and standard 
scores are presented in Table V-9 for the subtests and Table V-10 for 
total test scores. 
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Table V-l 



ELECTRONICS 
Test Specifications 



CURRICULUM CONTENT AREA 






I. Fundamentals of Electricity 

A. Direct current 

1. Electron physics 

2. Ohm’s Law (power and efficiency) 

a. Series , parallel circuits 

b. Series-parallel circuits 

3. Kirchoff's Law 

a. Series - parallel circuits 

b. Series - parallel circuits 

4. Loop analysis 

5. Node analysis 

6. Superposition theorem 

7. Norton's theorem 

8. Thevenin's theorem 

9. Electrostatics and capacitance 

10. Magnetism 

a. Permanent magnets 

b . Elect romagne tics 

c. Meter movements 

11. Time constants 

B. Alternating current 

1. Rotating vectors 

2. Voltage and current generation 

3. Reactance 

a. Capacitance 

b. Inductive 

c. Phase angles 

4. Impedence 

a. Series 

(1) l-r 

(2) C-R 

(3) L-C-R 

b. Parallel 

(1) L-r 

(2) C-R 

(3) L-C-R 
3. Resonance 

a. Series 

b. Parallel 
6. Transformers 



3 

1. 



1 

1 



3 

1 



1 

1 



1 

1 



1 

1 

4 



3 
5 

4 



3 
2 
1 

1 

4 
2 
1 
1 

4 

5 



2 

1 

2 

2 

1 



1 

1 

6 

2 

3 

4 
1 

2 

1 

2 

4 

1 

2 

2 

3 

5 

7 



3 

2 



II. FUNDAMENTALS OF ELECTRONICS 

A. Introduction to vacuum tubes 
1. Electron emission 
2.. Diodes 

3. Triodes 

4. Multi-element 



4 

1 

3 

2 



3 

4 

6 

11 



6 

6 

2 



1 

3 

1 
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B. Introduction to semi-conductors 

1. Solid-state physics 

2. Semi-conductor diodes 

3. Junction transistors 

4. Field effect transistors 

III. APPLICATION OF ELECTBONICS 

A. Active networks 

1. Power supply 

a. Half-wave 

b. Full-wave 

(1) Bridge 

(2) Conventional 

c. Voltage-multiplying 

d. Filter networks 

2. Anplifiers 

a. Voltage 

b. Current 

c. Power 

3. Oscillators 

a. Sinusoidal 

b. Non- sinusoidal 

4. Stabilization 

IV. SPECIAL CIRCUITRY 

A. Vave shaping 

1. Phase shifting 

a. Integrating circuits 

b. Differentiating circuits 

2. Harmonic analysis 

3. Clipping and clamping 

B. Non- sinusoidal oscillators 

1. Multi-' vibrators 

2. Relaxation 

3 . Blocking 

C. Feedback 

1. Positive 

2. Negative 

D. Gating circuits 

E. Logic circuits 

F. Switching circuits 

V. INSTRUMENTATION 
A. Basic meters 

1. Movements 

2. Circuits 
B- Oscilloscopes 

C. Transducers 

D. Application and limitations of 
measuring devices 



O 
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VI. 


SPECIAL DEVICES 












A. 


Gas tubes 


i 












1. Diodes 


2 












2. Thyratrons 




1 








B. 


Cathode - ray tubes 


1 


1 








C. 


Zener diode 


2 


1 








D. 


Tunnel diode 


2 


3 








E. 


Thertnisters 


1 




1 






F. 


Switching diodes 












G. 


Silicon control rectifiers 


1 










H. 


Syncro and servo systems 


4 


3 






VII. 


SYSTEMS ANALYSIS 












A. 


Block diagrams 


1 


3 


5 






B. 


Functional diagrams 














1- Signal flow 


1 


4 










2. Feedback loops 




1 










3. Functional analysis 


4 


7 


4 






C. 


Troubleshooting principles 


2 


4 


11 


4 





Table V-2 

ELECTRONICS - First Year 
Description of Sample 










State 


No. 


, of Inst. 


No. 


of Stu. 






Connecticut 




4 




115 






Georgia 




1 




6 






New Jersey 




1 




7 






North Carolina 




17 




143 






South Carolina 




6 




67 










29 




338 








Table V-3 












ELECTRONICS 












Experimental Tests 










Description and 


Reliabilities 










Time Limit 


No. of 


Items 


Reliability 




Subtest 


(Min) 


Form A 


Form B 


Form A 


Form B 


I 


Fund, of Electricity 


60 


50 


50 


.77 


.81 


II 


Fund, of Electronics 


50 


50 


50 


.77 


.75 


III 


Appl. of Electronics 50 


50 


50 


.78 


.83 


IV 


Special Circuitry 


50 


50 


50 


.77 


.81 


V 


Instrumentation 


30 


30 


30 


.76 


.71 


VI 


Special Devices and 














Systems Analysis 


40 


40 


40 


.66 


.56 




Total 


280 


270 


270 
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Table V-6 



ELECTRONICS 
Second Year 

Description of Sample 



State 


No. of Insitutions 


No. of Students 


Connecticut 


4 


102 


Georgia 


9 


89 


North Carolina 


13 


88 


Pennsylvania 


2 


14 


South Carolina 


8 


79 




36 


372 



*1 




Psychometric Characteristics 
Final Test 
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^Part-whole correlations 
Decimals omitted 



T*Me y~9 

RAW SCORE CONVERSIONS 



ELECTRONICS SU5TESIS 



Raw 

Score 




1 




2 






5 




4 




5 




6 


tile 


Std . 
Score 


tile 


Std . 
Score 


tile 


Std. 

Score 


Rile 


Std. 

Score 


tile 


Std. 

Score 


tile 


std. 

Score 


41 
















99 


794 










40 
















99 


782 










39 
















99 


771 










38 






99 


772 








99 


760 










17 






99 


762 








99 


749 










36 


99 


826 


99 


752 








98 


738 


99 


807 






33 


99 


813 


99 


742 








98 


726 


99 


794 






34 


99 


799 


98 


731 








97 


715 


99 


781 






33 


99 


7*3 




721 








96 


704 


99 


768 






32 


99 


771 


97 


711 








95 


693 


98 


733 






31 


99 


758 


96 


701 








94 


681 


97 


742 






30 


98 


744 


95 


690 








92 


670 


97 


729 






29 


97 


730 


93 


680 








91 


639 


96 


716 






28 


96 


716 


92 


670 








90 


648 


93 


703 






27 


93 


703 


90 


660 




99 


784 


89 


637 


93 


690 






26 


93 


689 


89 


649 




99 


770 


87 


625 


94 


677 






25 


93 


673 


88 


639 




99 


756 


86 


614 


92 


664 






24 


91 


661 


86 


629 




99 


742 


81 


603 


91 


631 






23 


90 


648 


84 


619 




99 


728 


80 


532 


89 


638 


99 


??8 


22 


89 


634 


82 


609 




98 


714 


79 


580 


85 


623 


99 


759 


21 


88 


620 


81 


598 




96 


700 


76 


369 


86 


612 


95 


740 


20 


83 


60S 


79 


388 




94 


687 


74 


358 




399 


98 


721 


19 


83 


393 


76 


378 




92 


673 


73 


347 


80 


356 


96 


702 


18 


81 


379 


73 


368 




90 


659 


71 


336 


78 


373 


94 


652 


17 


77 


365 


74 


35? 




88 


643 


69 


324 


7? 


360 


92 


663 


16 


76 


331 


71 


547 




86 


631 


65 


313 


?3 


347 


90 


6 4 4 


13 


73 


337 


69 


337 




83 


617 


64 


30? 


72 


334 


8? 


625 


14 


71 


324 


67 


527 




81 


603 


60 


491 


70 


321 


54 


606 


li 


69 


310 


63 


516 




78 


589 


36 


479 


66 


508 


80 


357 


12 


62 


496 


64 


306 




75 


376 


32 


468 


63 


493 


79 


567 


n 


36 


482 


62 


496 




73 


S62 


45 


43? 


38 


432 


76 


345 


10 


31 


469 


60 


486 




71 


548 


37 


446 


34 


469 


72 


329 


9 


42 


433 


36 


475 




68 


534 


31 


435 


48 


4 36 


64 


310 


8 


33 


441 


34 


t 65 




66 


520 


26 


423 


35 


443 


60 


491 


7 


26 


427 


31 


455 




64 


506 


21 


412 


>0 


4>0 


53 


471 


6 


21 


414 


47 


445 




63 


492 


15 


401 


27 


417 


41 


452 


3 


16 


400 


41 


434 




62 


478 


12 


390 


16 


404 


)1 


433 


4 


9 


336 


32 


424 




61 


463 


7 


379 


9 


391 


22 


414 


3 


3 


372 


23 


411 




60 


431 


1 


3t? 


3 


378 


13 


393 


2 


3 


359 


13 


404 




34 


43? 


1 


356 


2 


363 


10 


375 


1 


2 


345 


8 


394 




33 


423 


2 


345 


1 


331 


3 


336 



43 




Table V-10 



RAW SCORE CONVERSIONS 
ELECTRONICS TOTAL TEST 



Rav 

Score 


tile 


Std. 

Score 


Rav 

Score 


tile 


Std. 

Score 


Rav 

Score 


tile 


Std. 

Score 


Rav 

Score 


Zile 


Std. 

Score 


191 


99 


801 


138 


92 


673 


85 


70 


5 '*6 


32 


17 


418 


190 


99 


798 


137 


91 


671 


84 


70 


543 


31 


15 


416 


189 


99 


796 


136 


91 


668 


83 


70 


541 


30 


12 


414 


188 


99 


793 


135 


91 


666 


82 


69 


539 


29 


10 


411 


187 


99 


791 


134 


91 


664 


81 


69 


536 


28 


9 


409 


186 


99 


789 


133 


90 


661 


80 


68 


534 


27 


8 


406 


185 


99 


786 


132 


90 


659 


79 


68 


531 


26 


7 


404 


184 


99 


784 


131 


90 


656 


78 


68 


529 


25 


6 


401 


183 


99 


781 


130 


90 


654 


71 


67 


527 


24 


5 


399 


182 


99 


779 


129 


89 


652 


76 


67 


524 


23 


4 


397 


181 


99 


777 


128 


89 


649 


75 


67 


522 


22 


3 


394 


180 


99 


774 


127 


88 


647 


74 


67 


519 


21 


3 


392 


179 


99 


772 


126 


88 


644 


73 


67 


517 


20 


3 


389 


178 


99 


769 


125 


88 


642 


72 


66 


515 


19 


2 


387 


177 


99 


767 


124 


87 


640 


71 


66 


512 


18 


2 


385 


176 


99 


765 


123 


87 


637 


70 


65 


510 


17 


1 


382 


175 


99 


762 


12 2 


86 


635 


69 


65 


507 


16 


1 


380 


174 


99 


760 


121 


86 


632 


78 


65 


505 


15 


1 


377 


173 


99 


757 


120 


85 


630 


67 


64 


502 


14 


1 


375 


172 


99 


755 


119 


85 


628 


66 


64 


500 


13 


1 


375 


171 


99 


753 


118 


84 


625 


65 


63 


49? 


12 


1 


370 


170 


99 


750 


117 


84 


623 


64 


63 


495 


11 


1 


368 


169 


99 


748 


116 


84 


620 


63 


63 


493 


10 


1 


365 


168 


99 


745 


115 


83 


618 


62 


63 


490 


9 


1 


363 


167 


98 


743 


114 


83 


616 


61 


63 


488 


8 


1 


361 


166 


98 


741 


113 


83 


613 


60 


63 


486 


7 


1 


358 


165 


98 


7 38 


i;2 


82 


611 


59 


63 


483 


6 


1 


356 


164 


98 


736 


m 


81 


603 


58 


63 


481 








163 


98 


733 


i 10 


80 


606 


57 


63 


478 








162 


98 


731 


109 


80 


603 


56 


62 


476 








161 


97 


729 


108 


80 


601 


55 


62 


474 








160 


97 


726 


107 


80 


599 


54 


62 


471 








159 


97 


724 


106 


79 


596 


53 


61 


469 








158 


97 


721 


105 


79 


594 


52 


60 


466 








157 


97 


719 


104 


78 


591 


51 


59 


464 








156 


97 


717 


103 


77 


539 


50 


58 


462 








155 


97 


714 


102 


77 


587 


49 


57 


459 








154 


97 


712 


101 


77 


584 


48 


55 


457 








153 


96 


709 


100 


77 


582 


47 


55 


454 








152 


96 


707 


99 


76 


571 


4$ 


53 


452 








151 


96 


704 


98 


75 


577 


45 


51 


450 








150 


96 


702 


97 


74 


575 


44 


48 


447 








149 


95 


700 


96 


74 


572 


43 


45 


445 








148 


95 


697 


95 


74 


570 


42 


42 


442 








147 


94 


695 


94 


73 


567 


41 


40 


440 








146 


94 


692 


93 


72 


565 


40 


37 


438 








145 


94 


690 


92 


72 


56 1 


39 


35 


435 








144 


94 


688 


91 


71 


560 


38 


32 


433 








143 


93 


685 


90 


71 


558 


37 


30 


430 








142 


93 


683 


89 


71 


555 


36 


27 


428 








141 


92 


690 


88 


71 


553 


35 


24 


426 








140 


92 


678 


87 


71 


551 


34 


22 


42) 








139 


92 


676 


66 


70 


548 


33 


20 


421 
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CHAPTER VI 



AUTOMOTIVE MECHANICS 



A. EXPERIMENTAL TESTS 

.Tables VI-1 through VI-3 present test specif ications, des- 
criptions of the sample, and psychometric characteristics for the 
experimental tests. The subtesc reliabilities as shown in Table VI-3 
range from .51 to .85. Table VI-4 presents the intercorrelations and 
factor analysis for form A of the achievement test. All subtests, 
along with the Feeler Gauge, the Scope Dynamic, and the Tool Identifi- 
cation performance tests, load on factor 1 (see Appendix for a des- 
cription of performance tests). This factor which accounts for 4i 
per cent of the common variance, is a measure of achievement in 
automotive mechanics. 

Table VI-5 presents the intercorrelations and factor analysis 
for form B of the achievement test. All subtests, as well as the 
Mechanical Information, the Wide Fange Vocabulary reference tests 
and the Tool Identification performance test, load on factor 1, which 
accounts for 39 per cent of the common variance. None of the achieve- 
ment subtests load significantly on any of the other factors. 

B. FINAL TESTS 

Tables VI-6 and VI-7 present the description of the sample 
and psychometric characteristics of final tests. The reliabilities of 
the subtests range from .56 to .89, while the total test has a reli- 
ability of .97. None of the subtests are heavily skewed and all but 
the Power Train suh^est are slightly platykurtic. The Power Train 
subtest is highly leptokurtic and not significantly skewed, suggesting 
that most students scored close to the middle of the distribution. The 
intercorrelations for the subtests are presented in Table VI-8. This 
would have the result of reducing the variance and would account for 
the low reliability. 

Norns for converting raw scores to percentiles and standard 
scores are presented in Table VI-9 for the subtests and in Table VI-10 
for the total test. 
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Table VI-1 

AUTOMOTIVE MECHANICS OUTLINE 



Test Specifications 



CURRICULUM CONTENT AREA. 


K 


U 




A 

u 


I. TOOLS, SAFETY AND RELATED SCIENCE 










A. 


Care and use of tools 
1. Hand and power 


16 




2 






2. Measuring devices 


1 








B. 


Shop and personal aafety 
1. Use of power equipment 


2 


1 








2. Use of protective equipment 


2 




1 






3. Fire control and housekeeping 


2 








C. 


Mathematics and physics 


11 


2 


4 




II . ENGINES 










A. 


Fundamental types 
1. Construction 


23 


9 


2 






2. Operating characteristics 


23 


9 


5 


1 


B. 


Ierformance measures 
1. Testing procedures 


2 




3 






2. Output measurement 


3 




3 




C. 


Diagnosis of malfunctions 
1. Indications of trouble 


1 


6 


2 






2. Use of ''lectronic equipment 

3. Gauges and indicators 


1 




1 




D. 


Servicing and repair 
1. Minor adjustments 


1 


2 


8 






2. Major overhaul 


1 




3 






3. Tools and equipment 


2 




1 




III. FUEL SYSTEMS 










A. 


Fundamental types 


6 


2 






R. 


Operating principles 
1. Fuel pumps and injection 


5 


5 


2 






2. Carburization 


4 


6 


1 




C. 


Testing and diagnosis 
1. Use of equipment 


2 




1 






2. Troubleshooting 




5 


4 




IV. ELECTRICAL SYSTEMS 










A. 


Operating fundamentals 
1. Power and circuit theory 


22 


5 


1 






2. Timing and distributois 


6 


2 


1 






3. Generators and ignition 


22 


8 


1 




B. 


Diagnosis and service 
1. Problem areas 


2 


6 


5 






2. Test equipment 


11 




8 






3. Repair 


7 


1 


1 




V. CHASSIS AND SUSPENSION 










A. 


Fundamentals 
1. Springs and shocks 


7 


3 








2. Alignment 


9 


6 


1 


1 
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O 




B. 


Operating principles 




1. 


Steering mechanisms 




2. 


Stabilizer principles 


C. 


Service and repair 




1. 


Diagnosis of troubles 




2. 


Tool usage 




3. 


Alignment techniques 




4. 


Steering and balancing 


BRAKING 


SYSTEMS 


A. 


Fundamental types 




1. 


Drums and shoes 




2. 


Disc 




3. 


Hydraulic 


B. 


Operating principles 




1. 


Pressures, mechanical-hydraulic 




2. 


Friction coefficients 


C. 


Diagnosis and service 




1. 


Indications of trouble and 






adjustments 




2. 


Drum, line and cylinder repair 




3. 


Tool and equipment usage 


AIR 


CONDITIONING 


A. 


Fundamentals 




1. 


Meat absorption 




2. 


Evaporation - vaporization 


B. 


System operations 




1. 


Compressors 




2. 


Valves, receivers 


C. 


Diagnosis, service and repair 




1. 


Cold spots 




2. 


Recharging and gases 




3. 


Measuring equipment 



VI n. POWER TRAINS 

A. Fundamental systems 

1. Trt nsmission 

a. Straight gear 

b. Automatic 

2. Torque 

3. Differentials 

4. Clutches 

B. Operation 

1. Gear reductions and ratios 

2. Slip joints - splines 

3. Overdrives 

4. Universal 

C. Service, repair and test equipment 

1. Special tools 

2. Troubleshooting 

3. Techniques of assembly 

4. Clearance and specifications 

5. Testing techniques 



K 



U 







2 

3 



7 

1 

1 



1 

5 

7 

1 

1 



1 

4 

2 

1 



1 



2 

1 

4 



2 

3 



4 

2 

2 



2 

2 

2 

2 
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Table VI-2 



AUTOMOTIVE MECHANICS 
First Year 



Description of Sample 



State 


No. of Inst. 


No. of Students 


Delaware 


1 


9 


Georgia 


1 


12 


New Jersey 


3 


40 


North Carolina 


22 


219 


South Carolina 


9 


82 




36 


362 



Table VI-3 

AUTOMOTIVE MECHANICS 



Experimental Tests 
Description and Reliabilities 





Time 

Subtest 


Limit 

(min) 


No. of 
Form A 


Items 
Form B 


Reliability 
Form A Form B 


1 


Tools, Safety, Related 
Science 


15 


19 


18 


.67 


.51 


11 


Engines 


50 


53 


53 


.84 


.85 


III 


Fuel Systems 


15 


20 


20 


.71 


.70 


IV 


Electrical Systems 


50 


54 


54 


.83 


.84 


V 


Chassis and Suspension 


20 


27 


27 


.71 


.79 


VI 


Braking Systems 


20 


27 


26 


.82 


.63 


VII 


Air Conditioning 


15 


16 


16 


.64 


.71 


VIII 


Power Trains 


20 


26 


26 


.80 


.59 




205 


242 


2*0 
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Table VI-6 



AUTOMOTIVE MECHANICS 
Second Year 



Description of Sample 



State 


No. of Inst. 


No. of St u. 


Delaware 


i 


16 


Georgia 


10 


72 


New Jersey 


2 


25 


North Carolina 


26 


26B 


Pennsylvania 


2 


36 


South Carolina 


9 


97 


Virginia 


1 


9 




51 


525 



51 
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r*bu vr-9 

RAW SCORE CONVERSIONS 
>UTOt»TIVr MECHANICS SUBTESTS 



I 2 3 J 5 i L 



Kjv 

Score 


til* 


Std, 

Scor* 


XU* 


Std. 

Scr,r* 


til* 


Std. 

Scot* 


till 


Std. 

Scon 


tile 


Std. 

Score 


til* 


Std. 

Scor* 


til* 


Std. 

Score 


39 


99 


723 


























58 


99 


714 


























57 


99 


704 


























56 


98 


694 


























55 


97 


684 


























5$ 


97 


675 


























53 


95 


665 


























52 


95 


655 


























51 


93 


646 


























50 


91 


636 


























49 


89 


626 


























48 


88 


617 










99 


759 














47 


66 


607 










99 


747 














46 


83 


597 










99 


734 














45 


79 


587 










99 


722 














44 


77 


578 






99 


717 


99 


709 


99 


729 










43 


73 


568 






99 


705 


98 


696 


99 


716 










42 


70 


558 






93 


693 


97 


684 


99 


703 










41 


67 


549 






97 


632 


96 


671 


99 


690 










40 


64 


539 






96 


670 


94 


659 


98 


676 










39 


41 


529 






94 


658 


93 


646 


97 


663 










38 


59 


519 






91 


647 


91 


634 


95 


650 










37 


55 


510 






89 


635 


88 


621 


91 


63? 










36 


52 


500 






88 


623 


85 


609 


89 


624 










35 


49 


490 






86 


611 


83 


596 


87 


611 










34 


46 


481 






83 


600 


79 


583 


83 


598 






99 


800 


33 


43 


471 






79 


588 


77 


571 


79 


585 






99 


800 


32 


39 


461 






76 


576 


73 


558 


75 


572 






99 


800 


31 


36 


451 






75 


565 


69 


546 


72 


559 






99 


800 


30 


31 


442 






72 


553 


66 


533 


68 


546 






99 
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29 


27 


432 






68 


541 


60 


521 


64 
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28 


25 


422 
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691 


64 


530 


56 
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59 


520 
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27 


21 


413 


99 


672 


60 


518 


51 


495 


54 


507 






99 


800 


26 


19 


403 


97 


654 


56 


506 


47 


483 


49 


493 






99 
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25 


16 


393 


94 


636 


52 
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41 


470 


45 


480 


99 


740 


99 


800 


24 


14 


383 


90 


618 


48 


483 


37 


458 


42 


467 


99 


723 


99 


785 


23 


11 


374 


84 


600 


43 


471 


33 


445 


35 


454 


99 


707 


99 


759 


22 


9 


364 


78 


581 


39 


459 


29 


433 


31 


441 


99 


690 


99 


733 


21 


9 


354 


71 


563 


35 


448 


25 


420 


27 


428 


97 


674 


99 


708 


20 


7 


345 


66 


545 


30 


436 


21 


408 


21 


413 


96 


657 


99 


682 


19 


6 


335 


60 


527 


23 


424 


18 


395 


16 


402 


94 


640 


99 


656 


18 


5 


325 


55 


509 


21 


412 


14 


382 


15 


389 


91 


624 


95 


631 


17 


3 


316 


49 


491 


18 


401 


11 


370 


12 


376 


87 


607 


92 


605 


16 


2 


306 


41 


472 


17 


389 


8 


357 


10 


363 


84 


590 


85 


579 


15 


1 


296 


37 


454 


13 


377 


6 


345 


8 


350 


79 


574 


75 


553 


14 


1 


286 


31 


43C 


10 


366 


4 


332 


6 


337 


74 


557 


65 


526 


13 


1 


277 


25 


418 


9 


354 


3 


320 


5 


324 


67 


540 


54 


502 


12 


1 


267 


20 


400 


6 


342 


2 


307 


3 


310 


59 


524 


41 


476 


n 


1 


257 


16 


?81 


4 


330 


1 


294 


2 


297 


50 


507 


31 


451 


10 


1 


248 


12 


363 


2 


319 


1 


282 


2 


284 


44 


491 


2) 


425 


9 


1 


238 


8 


345 


2 


307 


1 


269 


1 


271 


38 


474 


16 


399 


8 


1 


228 


6 


327 


1 


295 


1 


257 


1 


258 


33 


457 


12 


374 


7 


1 


218 


4 


309 


1 


284 


1 


244 


1 


245 


28 


441 


8 


3*8 


t> 


1 


209 


2 


291 


1 


272 


1 


232 


1 


232 


24 


424 


5 


322 


5 


1 


200 


1 


272 


1 


260 


1 


219 


1 


219 


21 


407 


3 


296 


4 


1 


200 


1 


254 


1 


248 


1 


207 


1 


206 


19 


391 


2 


271 


3 


1 


200 


1 


236 


1 


237 


l 


200 


1 


200 


16 


374 


2 


245 


2 










1 


225 


l 


200 


1 


200 


15 


357 


1 


219 


1 










1 


213 


1 


200 


1 


200 


13 


341 


1 


200 
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Table VI-10 



RAW SCORE CONVERSIONS 
AUTOMOTIVE MECHANICS TOTAL TEST 



Rav 

Score 


Xlle 


Std. 

Score 


Raw 

Score 


Xlle 


Std, 

Score 


Rav 

Sco^e 


Xlle 


Std. 

Score 


Rav 

Score 


Xlle 


Std. 

Score 


256 


99 


742 


202 


84 


611 


148 


45 


480 


94 




349 


255 


99 


740 


201 


84 


609 


147 


43 


477 


93 


6 


346 


254 


99 


737 


200 


84 


606 


146 


42 


475 


92 


6 


344 


253 


99 


735 


199 


83 


604 


145 


41 


472 


91 


5 


341 


252 


99 


732 


198 


83 


601 


144 


40 


470 


90 


5 


339 


251 


99 


730 


197 


82 


599 


143 


39 


468 


89 


4 


336 


250 


99 


728 


196 


82 


596 


142 


38 


465 


88 


4 


334 


249 


99 


725 


195 


81 


594 


141 


37 


463 


87 


4 


331 


243 


99 


723 


194 


80 


592 


140 


36 


460 


86 


4 


329 


247 


99 


720 


193 


79 


589 


139 


36 


458 


85 


3 


327 


246 


99 


718 


192 


79 


587 


138 


35 


455 


84 


3 


324 


245 


99 


715 


191 


78 


584 


137 


34 


453 


83 


3 


322 


244 


99 


713 


190 


77 


582 


136 


34 


451 


82 


3 


319 


243 


99 


711 


189 


77 


579 


135 


?3 


448 


81 


3 


317 


242 


99 


708 


188 


76 


577 


1?4 


32 


446 


80 


2 


314 


241 


99 


706 


187 


75 


575 


133 


30 


443 


79 


2 


312 


240 


98 


703 


186 


74 


572 


132 


29 


441 


78 


2 


310 


239 


98 


701 


185 


74 


570 


131 


29 


438 


77 


2 


307 


238 


98 


698 


184 


73 


567 


130 


27 


436 


76 


1 


305 


237 


98 


696 


183 


72 


565 


129 


27 


434 


75 


l 


302 


236 


98 


694 


182 


72 


562 


128 


27 


431 


74 


1 


300 


235 


98 


691 


181 


70 


560 


127 


25 


429 


73 


1 


297 


2 34 


97 


689 


180 


69 


557 


126 


24 


426 


72 


1 


295 


233 


97 


686 


179 


69 


555 


125 


24 


424 


71 


1 


293 


232 


97 


684 


178 


68 


553 


124 


23 


421 


70 


1 


290 


231 


97 


681 


177 


67 


550 


123 


22 


419 


69 


1 


288 


230 


97 


679 


176 


67 


548 


122 


22 


417 


68 


1 


285 


229 


96 


677 


175 


66 


545 


121 


21 


414 


6: 


1 


283 


2/28 


96 


674 


174 


65 


543 


120 


20 


412 


66 


1 


280 


22/ 


96 


672 


173 


65 


540 


119 


20 


409 


65 


1 


278 


226 


96 


669 


172 


64 


538 


110 


19 


407 


64 


1 


276 


225 


96 


667 


171 


63 


5j6 


117 


18 


404 


63 


1 


273 


224 


9:> 


664 


170 


63 


533 


116 


18 


402 


62 


1 


271 


223 


95 


662 


169 


62 


531 


115 


18 


400 


61 


1 


268 


222 


94 


660 


168 


61 


528 


114 


17 


397 


60 


1 


266 


221 


94 


657 


167 


61 


526 


113 


17 


395 


59 


1 


263 


220 


94 


655 


166 


60 


523 


112 


17 


392 


58 


1 


2 61 


219 


93 


652 


165 


60 


521 


111 


16 


390 


57 


1 


259 


218 


93 


650 


164 


59 


519 


110 


15 


387 


56 


1 


256 


217 


92 


647 


163 


58 


516 


109 


14 


385 


55 


1 


254 


216 


91 


645 


162 


57 


514 


108 


13 


383 


54 


1 


251 


215 


91 


643 


161 


56 


511 


107 


12 


380 


53 


1 


249 


214 


91 


640 


160 


55 


509 


106 


11 


378 


52 


1 


246 


213 


90 


638 


159 


54 


506 


105 


11 


375 


51 


1 


244 


212 


89 


635 


158 


53 


504 


104 


11 


373 


50 


1 


242 


211 


88 


633 


157 


52 


502 


103 


11 


370 


49 


1 


239 


210 


88 


630 


156 


50 


499 


102 


10 


368 


48 


1 


237 


209 


88 


628 


155 


50 


497 


101 


10 


366 


47 


1 


2 34 


203 


87 


626 


154 


49 


494 


100 


9 


363 


46 


1 


232 


207 


87 


623 


153 


48 


492 


99 


8 


361 


45 


1 


229 


206 


86 


621 


152 


48 


489 


98 


8 


358 


44 


1 


227 


205 


86 


618 


151 


47 


487 


97 


7 


356 


43 


1 


225 


204 


85 


616 


150 


47 


485 


96 


7 


353 


42 


1 


222 


203 


85 


613 


149 


46 


482 


95 


7 


351 
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CHAPTER VII 



MACHINIST 



A. EXPERIMENTAL TESTS 

Tables VII-1 through VII-3 present test specifications, the 
description of the sample, and the psychometric characteristics for the 
experimental tests. From Table VII-3 it can be seen that the reliabil- 
ities of the subtests range from .09 to .85. Table VII-4 presents the 
intercorrelations and factor analysis for form A of the experimental 
test. All subtests, as well as the Mechanical Information and the 
Inference reference tests and the Micrometer performance test, load 
on factor 1. As this factor accounts for 43 per cent of the common 
variance and explains virtually all of the intercorrelations among the 
achievement tests, it can be concluded that the subtests are heasuring 
a common dimension of achievement in the Machinist trade. Table VII-5 
presents the intercorrelations and factor analysis for form B. All 
subtests, as well as the Micrometer, the Indexing, and the Truing 
performance tests, load on factor 1. This factor accounts for 34 per 
cent of the common factor variance and can be considered as measuring 
a common dimension of achievement. 

B. FINAL TEST 

Tables VII-6 through VII-8 present the description of the 
sample, the psychometric characteristics, and the intercorrelations 
for the final test. From Table VII-7 it can be seen that the reliabil- 
ities of the total test is .95, with subteot reliabilities ranging from 
.31 to .87. None of the subtests are skewed and are essentially 
mesokurtic. The total test is slightly positively skewed and is 
mesokurtic. The intercorrelations presented in Table VII-8 chow that 
the subtests are homogeneous with respect to shared variance. 

Tables VII-9 and VII-10 present conversions from raw scores 
to percentiles and standard scores for subtests and total tests re- 
spectively. 
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Table VII-1 
MACHINIST TRADE 



Test Specifications 







CURRICULUM CONTENT AREA 


K 


U 




A 

u 


I. 


SAFETY PROCEDURES 












A. 


Personal 


5 


2 


3 






B. 


Shop 


5 


1 






II. 


HAND TOOLS AND APPLICATIONS 












A. 


Hand tools 


7 


6 


5 






B. 


Cutting tools 


4 




1 






C. 


Taps, drills, reamers 


8 




3 






D. 


Files and processes 


6 


1 


3 




III. 


MEASURING TOOLS AND PROCESSES 












A. 


Layout and planning 


18 


6 


11 






B. 


Indirect measurement 


4 


2 


1 






C. 


Direct measurement 


15 


7 


9 






D. 


Electrolimit gauges 


4 


2 








E. 


Optical flats 


1 


1 








F. 


Mathematics 


7 


3 


49 






G. 


Blue print reading 


3 


9 


3 


7 


IV. 


CUTTING TOOLS 












A. 


Geometry and theory 


17 


21 


12 


1 




B. 


Cutting steels and alloys 




1 








C. 


Carbides and ceramics 




2 


1 




V. 


MILLING MACHINES 












A. 


Horizontal 


10 


11 


12 






B. 


Vertical 


1 




4 






C. 


Universal 


2 


6 


7 






D. 


Feeds and speeds 






2 




VI. 


LATHES 












A. 


Standard engine - tjol room 


31 


19 


23 


2 




£. 


Turret and screw machines 


1 


2 


2 






C. 


Formulae and math 


2 


1 


4 




VII. 


GRINDING MACHINES 












A. 


Safety procedures 




2 


3 






B. 


Bench and tool grinding 
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1 
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Surface grinding 
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Cylindrical grinding 
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9 
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1 
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2 
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MINOR MACHINES 
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Drill press 


9 


4 


11 






B. 


Shaper, planer 


2 


2 


6 






C. 


Power cutoff 


1 


1 


2 






D. 


Numerical control machines 


5 




3 




IX. 


METALLURGY 












A. 


Composition of metals 


8 


6 


1 






B. 


Application - choosing metal for job 


5 


1 


3 






C. 


Heat treatment 


2 


8 


7 
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Table VII-2 



MACHINIST 
First Year 

Description of Sample 



State 


No. of Inst. 


No. of Students 


Delaware 


1 


11 


Georgia 


1 


9 


New Jersey 


3 


35 


North Carolina 


11 


118 


South Carolina 


23 


67 




23 


240 



Table VII-3 

MACHINIST 
Experimental Tests 



Description and Reliabilities 





Sub test 


Time Limit 
(min) 


No. of Items 
Form A Form B 


Reliability 
Form A Form B 


I 


Safety Procedure 


10 


14 


13 


.55 


.09 


II 


Hand Tools & Application 20 


22 


22 


.63 


.64 


III 


Measuring Tools & 


Processes 70 


83 


84 


.85 


.77 


IV 


Cutting Tools 


20 


27 


26 


.68 


.57 


V 


Lathes 


40 


42 


41 


.83 


.78 


VI 


Milling Machines 


20 


26 


26 


.63 


.67 


VII 


Grinding Machines 


20 


25 


25 


.60 


.68 


VIII 


Metalluigy 


20 


20 


21 


.60 


.51 


IX 


Minor Machines 


20 


23 


23 


.70 


. 66 






240 


282 


281 
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INTERCORRELATIONS AND FACTOR LOADINGS FOR 
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Decimals omitted 
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Table VII-6 



MACHINIST 
Second Year 

Description of Sample 



State 


No. of Inst. 


No. of Students 


Delaware 


i 


13 


Georgia 


10 


62 


New Jersey 


2 


26 


North Carolina 


12 


104 


Pennsylvania 


2 


11 


South Carolina 
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Virginia 
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14 




37 


332 
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*Part- whole correlations 
Decimals omitted 
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67 


539 


59 


510 


86 


610 


1 


284 


59 


518 


50 


4V0 


79 


583 


l 


275 


51 


498 


43 


470 


74 


556 


1 


260 


45 


478 


36 


451 


66 


529 






37 


458 


29 


431 


58 


502 






30 


437 


22 


411 


50 


475 






24 


417 


17 


391 


39 


448 






20 


397 


12 


371 


30 


422 






14 


376 


9 


351 


19 


395 






9 


356 


6 


332 


9 


368 






5 


336 


2 


312 


5 


341 






3 


315 


1 


292 


2 


314 






1 


295 


1 


272 


1 


287 






1 


275 


1 


252 


1 


260 






1 


254 






1 


233 






1 


234 














1 


2L4 







99 


735 














99 


72(J 














99 


705 














98 


690 














98 


675 














95 


661 














92 


646 














90 


631 














66 


616 














64 


601 














60 


587 


99 


742 










76 


572 


99 


724 










72 


557 


58 


706 










67 


542 


97 


688 










62 


528 


96 


670 










58 


513 


94 


652 


99 


800 






52 


498 


91 


634 


99 


603 






47 


483 


83 


615 


99 


788 






42 


468 


84 


597 


99 


763 






37 


454 


79 


579 


99 


738 






32 


439 


72 


561 


99 


712 






28 


424 


68 


543 


98 


687 






23 


409 


62 


525 


96 


662 






18 


394 


57 


507 


94 


637 


99 


755 


15 


380 


52 


488 


89 


612 


99 


716 


9 


365 


45 


470 


82 


586 


98 


676 


7 


350 


39 


452 


76 


561 


94 


639 


4 


335 


32 


4 34 


69 


536 


91 


601 


3 


320 


26 


416 


5? 


511 


81 


562 


2 


306 


19 


398 


49 


486 


67 


524 


1 


291 


14 


379 


40 


460 


47 


485 


1 


276 


7 


361 


28 


435 


33 


447 


1 


261 


4 


343 


21 


410 


18 


406 


1 


246 


2 


325 


13 


365 


12 


370 






1 


307 


10 


360 


7 


332 






1 


269 


6 


335 


4 


293 






1 


271 


4 


309 


2 


255 






1 


252 


3 


284 


2 


216 



62 



Table V1I-10 



RAW SCORE CONVERSIONS 
MACHINIST TOTAL TEST 



Raw 

Score 


Xile 


Std. 

Score 


Rev 

Score 


XU* 


St <3* 
Score 


Rev 

Score 


Xlle 


Std • 
Score 


Rev 

Score 


XU* 


Std. 

Score 


224 


99 


748 


170 


80 


592 


116 


30 


437 


62 


1 


281 


223 


99 


745 


169 


79 


590 


115 


29 


434 


61 


1 


278 


222 


99 


742 


168 


78 


587 


114 


28 


431 


60 


1 


275 


221 


99 


740 


167 


78 


564 


113 


27 


428 


59 


1 


272 


220 


99 


737 


166 


77 


581 


112 


26 


425 


58 


1 


269 


219 


99 


734 


165 


76 


578 


111 


25 


422 


57 


1 


267 


218 


99 


731 


164 


76 


575 


no 


24 


419 


56 


1 


264 


217 


99 


728 


163 


76 


572 


109 


23 


417 


55 


1 


261 


216 


99 


725 


162 


75 


569 


108 


21 


414 


54 


1 


2*0 


215 


99 


722 


161 


74 


5*7 


107 


21 


411 








214 


99 


719 


160 


73 


564 


106 


20 


408 








213 


99 


716 


159 


72 


561 


105 


19 


405 








212 


99 


714 


158 


71 


553 


104 


19 


402 








211 


99 


711 


157 


70 


555 


103 


18 


399 








210 


99 


706 


156 


69 


552 


102 


18 


396 








209 


98 


705 


155 


69 


549 


101 


16 


393 








20 a 


98 


702 


154 


67 


546 


100 


15 


391 








207 


98 


699 


153 


66 


563 


99 


14 


388 








206 


95 


696 


152 


64 


541 


98 


13 


385 








205 


97 


693 


151 


64 


558 


97 


11 


382 








204 


97 


691 


150 


63 


535 


96 


1) 


379 








203 


96 


688 


149 


63 


532 


95 


10 


376 








202 


96 


685 


148 


62 


529 


94 


9 


373 








201 


96 


682 


147 


62 


526 


93 


8 


370 








200 


96 


679 


146 


61 


523 


92 


6 


36? 








199 


95 


676 


145 


60 


520 


91 


6 


365 








198 


94 


673 


144 


59 


517 


SO 


5 


362 








197 


94 


670 


143 


58 


515 


89 


5 


359 








196 


94 


667 


142 


57 


512 


88 


5 


356 








195 


94 


665 


141 


56 


505 


87 


4 


353 








194 


94 


662 


140 


56 


506 


86 


4 


350 








193 


94 


659 


139 


56 


503 


85 


4 


347 








192 


94 


656 


138 


55 


500 


54 


4 


344 








191 


93 


653 


13? 


53 


49? 


33 


4 


342 








190 


92 


650 


136 


52 


4*4 


82 


4 


339 








189 


92 


647 


135 


51 


492 


81 


3 


336 








188 


92 


644 


134 


50 


489 


80 


3 


333 








187 


91 


642 


133 


47 


486 


79 


3 


330 








186 


90 


639 


132 


46 


433 


76 


3 


327 








185 


89 


636 


131 


45 


480 


77 


3 


324 








184 


88 


633 


130 


44 


4?7 


76 


3 


321 








183 


88 


630 


129 


43 


474 


75 


2 


318 








182 


86 


627 


128 


43 


471 


74 


2 


316 








181 


86 


624 


127 


42 


468 


73 


1 


313 








180 


84 


621 


126 


42 


466 


?2 


1 


310 








179 


84 


618 


125 


40 


463 


71 


1 


30? 








178 


84 


616 


124 


38 


460 


70 


1 


304 








177 


83 


613 


123 


38 


457 


69 


1 


301 








176 


83 


610 


122 


36 


454 


68 


1 


298 








175 


83 


607 


121 


35 


451 


67 


1 


295 








174 


82 


604 


120 


34 


448 


66 


1 


293 








173 


82 


601 


119 


34 


445 


65 


1 


290 








172 


81 


598 


118 


32 


442 


64 


1 


287 








171 


80 


595 


13? 


30 


440 


63 


1 


284 
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CHAPTER VIII 



AIR CONDITIONING, HEATING AND REFRIGERATION 

A. EXPERIMENTAL TEST 

Tables VIII-1 through VIII-3 present test specifications, 
descriptions of the sample and detailed psychometric characteristics 
for the experimental Air Conditioning, Heating and Refrigeration 
tests. From Table VIII-3 it can be seen that the reliabilities of the 
experimental sublets range from .45 to .86. Table VIII-4 presents 
the Intercorrelations and factor analysis results. It can be seen 
that factor I, which accounts for 48 per cent of the common variance, 
explains most of the correlations among the achievement subtests. 

Subtests I through IV at.u VI have vary high loadings on factor 1, 
while subtests V and VII have moderate loadings on this factor. Among 
the reference tests, mechanical information and inference load moder- 
ately on factor 1. Thus, mechanical knowledge and general reasoning 
seem to be relevant abilities related to successful performance cn 
this achievement test. Several of the reference tests load significantly 
on f Actor 4, although this factor is unrelated to performance on the 
achievement tests. 

B. FINAL TEST 

The description of the final sample is presented in Table 
VIII-5, and the psychometric characteristics of this test are presented 
in Table VIIt-6. It can be seen from this table that the reliability 
of the subtests ranged from .62 to .89, with the total test having a 
rellAbl’^’.y of .95. It can alco be seen that skewness is not large 
for any of the subtests except number II, which is negatively skewed. 
Kurtosis is not large for any of the subtests except number II and 
the total test. Both are leptokurtlc, meaning that the students' 
scores cluster about the mean to a greater degree than normal. Frota 
the Intercorrelations in TAble VIII-7 it can be seen that the subtests 
have moderate to high Intercorrelations. 

Norms for converting raw scores to percentiles and standard 
scores are presented in Table VIII-8 for subtests and Table VIII-9 for 
total test scores. 
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Table VIII-1 



AIR CONDITIONING, HEATING, AND REFRIGERATION 
Teat Specifications 



CURRICULUM CONTENT AREA 



K U 






A 



u 



I. PRINCIPLES OF REFRIGERATION 

A. Basic terminology 

1. Heat and temperature 

2. British thermal unit 

3. Specific heat 

4. Gauge pressure 

5. Absolute pressure 

6. Superheat 

7. Methods of heat transfer 

8. Matter and energy 

B. Temperature, pressure, volume 

1. Charles' Law 

2. Dalton's Law 

3. Boyle 'a Law 

4. Evaporation and condensation 

C. Mechanical refrigeration cycles 

1. Compression 

2. Absorption 

II. REFRIGERATION APPLICATIONS 

A. Hermetic compressor 

1. Reciprocating 

2. Rotary 

B. Capillary tube 

C. Evaporators 

1. Gravity 

2. Forced converted 

3. Liquid and air cooling 

D. Condensers 

1. Gravity 

2. Forced convected 

3. Air and water cooled 

E. Motors 

1. Shaded pole 

2. Split phase 

3. Capacitor start 
A. Induction 

F. Controls 

1. Thermostats and defrost 

2. Relays 

3. Overloads 

G. Installation And service problems 

1. Leaks, fans, pumps, piping 

2. Compressor, motors 

3. Defrosting, draining, moisture 



12 

2 

2 

1 

1 

1 

1 

2 

6 

2 

1 

1 

1 

9 

3 

8 



5 

1 



1 

2 

1 

1 

3 

5 
13 

6 



3 

2 

4 
2 
1 

2 

1 

1 



1 



1 



4 

2 

3 



1 

1 2 
2 1 

3 2 2 

1 



3 

4 



1 

6 



3 
1 
1 

8 

4 



1 

3 1 
1 

2 3 1 

1 
2 

7 2 2 

1 

4 1 

2 1 

2 

11 

9 6 1 

8 4 3 
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K 


U 


A 


A 
u 


H. 


Equipment selection 




3 


4 






1. 


Floats and coils 


5 


5 


4 






2. 


Capillary tubes and expansion valves 


5 


3 


1 


2 




3. 


Evaporators and condensers 


3 


7 


6 


1 


I. 


Commercial system accessories 


5 


10 


3 


2 




1. 


Vibration eliminators 












2. 


Oil separators 


2 










3. 


Pressure regulators 


1 


1 








4. 


Solenoid and check valve 


1 


1 


1 




CONTROLS 










A. 


Instrumentation 












1. 


Sensing element 


4 


4 


2 






2. 


Controller 


2 


3 








3. 


Actuator 


1 


1 


1 




B. 


Control circuit electricity 


2 


4 








1. 


Voltage, current, resistance 


3 


1 








2. 


Ohm 1 8 Law 


1 


1 


1 






3. 


Power 


3 


2 








4. 


Transformers 












5. 


Electromagnetism 


1 










6. 


Parallel and series circuits 


1 


1 


1 




C. 


Electric systems 


6 


5 


3 


4 


D. 


Pneumatic systems 


6 


3 


1 


1 


AIR 


CONDITIONING AND HEATING 










A. 


Heating 












1. 


Warm air 


2 


4 




1 




2. 


Hot water 


2 




1 






3. 


Steam 


1 


2 


1 






4. 


Heat pump 


2 




1 






5. 


Fuels and burners 


10 


6 


3 


2 


B. 


Cooling 












1. 


Direct expansion 


7 


6 


1 






2. 


Chilled water 


1 


8 








3. 


Absorption 


3 


2 






C. 


Installation and service problems 












i. 


Fuels and burners 


9 


12 


6 


1 




2. 


blowers, motors, and static pressure 


2 


3 


1 






3. 


Pumps, pipe and head 


1 


3 


1 






4. 


Hydronic accessories 






3 






5. 


Duct fabrication and installation 




3 








6. 


Furnace, boiler and heat pump 




4 


1 






7. 


Electric heating elements 


3 


1 


2 






8. 


Defrost controls, metering devices 


4 


3 








9. 


Compressor, condenser, evaporator 




4 


5 


2 


D. 


Properties of air and the pcychometric 












chart 












1. 


Absolute temperature and pressure 




1 








2. 


Temperature, pressure, and volume 


1 


1 


1 






3. 


Density and specific volume 


1 


1 


1 


1 




4. 


Standard air 


2 




1 






5. 


Dry bulb, wet bulb and dew point 


5 


3 


2 


3 




6. 


Humidity ratio * degree saturation 


2 


2 








7. 


Sensible heat ratio 


2 


2 


2 


5 



o 
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E. 



F. 







K 


U 




Heat loss and gain 








1 . 


Design and conditions 


2 


1 




2. 


U factors 






1 


3. 


Conduction, infiltration and 










ventilation 


2 


1 




4. 


Internal and solar gains 


4 






Systems design 








l. 


Air 


9 


1 


2 


2. 


Water 


5 




3 


3. 


Steam 









V. 



BLUEPRINT READING AND ESTIMATING 
A. Mechanical print reading 



VI. 





1. Orthographic and isometric 








interpretation 


2 


6 




2. Three-dimensional layouts 


6 


4 


B. 


Plans and specifications 


2 


3 




1. Drawing symbols and abbreviations 


7 


1 




2. General and mechanical 


5 


1 


C. 


Take-off procedures 








1. Equipment, material, labor 


1 


4 


MATERIALS, TOOLS AND SAFETY 






A. 


Refrigerants 








1. Class I, 11, 111 


5 


3 


B. 


Refrigerant Oils 


3 


1 


C. 


Copper ti'he and fitting and valves 


7 


3 


D. 


Pipe and fittings and valves 


3 


3 


E. 


Sheet metal, pipe and duct insulation 


6 


2 


F. 


Pipe cutter, threaders, reamers 


3 


2 


G. 


Sheet metal hand tools and shop equip. 


12 


3 


11 . 


Refrigerant hand tools 


6 


2 


I. 


Safety 








1. Hand tools 


1 






2. Shop equipment 




1 




3. Refrigerant 


1 


4 




4. Electrical 




3 




5. On-the-job practice 


2 


2 
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Table VIII-2 



AIR CONDITIONING, HEATING AND REFRIGERATION 
First Year 

Description of Sample 



State 


No. of Inst. 


No. of Stu. 


Georgia 


1 


10 


North Carolina 


6 


53 


South Carolina 


9 


89 




16 


152 



Table VIII-3 

AIR CONDITIONING, HEATING AND REFRIGERATION 
Experimental Tests 



Description and Reliabilities 



Subtest 


Time Limit 
(min) 


No. of Items 


Reliability 


I. Fundamentals 


35 


44 


.75 


II Refrigeration 


65 


75 


.80 


III Air Conditioning 


65 


76 


.83 


IV Controls 


30 


40 


.80 


V Blueprint reading 


20 


25 


.86 


VI Materials, Tools and 


Equipment 15 


20 


.65 


VII Estimating Controls 


15 


20 


.45 




245 


300 
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Table VIII-4 

AIR CONDITIONING, HEATING AND REFRIGERATION 
Intercorrelations and factor loadings 



CM 
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able VIII-5 



AIR CONDITIONING, HEATING AND REFRIGERATION 
Second Year 



Description of Sample 



State 


No. of Inst. 


No. of Stu. 


Georgia 


8 


46 


North Carolina 


8 


73 


Pennsylvania 


1 


7 


South Carolina 


8 


62 


Virginia 


1 


16 




26 


204 



71 
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mi* vm-8 

RAW SCORE CONVERSIONS 

AIR CONDITIONING, HEATING AND REFRIGERATION SUBTEST 



1 2 ) 4 5 6 

Raw Std. Std. Std. SCd. Std. Std. 

Score tile Scon Silt Score Hie Score tile Score Hie Score Hie Score 



69 

68 

6 ? 

66 

65 

64 

6 ) 

62 

61 

60 

59 

58 

5? 

56 

55 

54 



5) 






99 


721 






52 






99 


710 






51 






99 


699 






50 






99 


667 






49 






98 


676 






48 






97 


665 






47 






96 


65) 






46 






96 


642 






45 






94 


6)1 






44 






91 


619 






4) 






89 


608 






42 






65 


5C6 






41 






81 


585 






40 






79 


574 






)9 






75 


562 






W 






68 


551 






)? 






6) 


540 






)6 






60 


528 






)S 






54 


517 






)4 






51 


506 






)) 






47 


494 






)2 






44 


48) 






)1 






)? 


472 






)0 






)) 


460 






29 






29 


449 


99 


800 


28 






26 


4)8 


99 


800 


27 


99 


716 


21 


426 


99 


76) 


26 


99 


69) 


19 


415 


99 


761 


25 


98 


670 


16 


404 


99 


7)9 


>4 


95 


647 


1) 


)92 


98 


717 


2) 


89 


625 


11 


>81 


97 


695 


72 


85 


602 


9 


)69 


95 


67) 


21 


80 


579 


7 


) 58 


94 


651 


20 


72 


556 


5 


)47 


91 


629 


19 


65 


5)) 


5 


))5 


86 


606 


18 


58 


511 


4 


)24 


8) 


584 


1) 


5) 


488 


3 


11) 


77 


562 


16 


40 


465 


2 


>01 


72 


540 


15 


)> 


442 


1 


290 


62 


518 


14 


27 


420 


1 


279 


5) 


496 


1) 


19 


)97 


1 


267 


44 


474 


12 


10 


) 7 4 


1 


256 


>8 


452 


11 


7 


) 51 


1 


245 


29 


429 


10 


4 


)28 


1 


2)) 


21 


407 


9 


i 


>06 


1 


227 


17 


>85 


S 


1 


28) 


1 


211 


9 


)6) 


7 


1 


260 


1 


200 


5 


>41 


6 


1 


2)7 


1 


200 


) 


)19 


5 


1 


215 


1 


700 


1 


297 


4 


1 


700 


1 


700 






) 


1 


700 


1 


200 






2 


1 


700 


1 
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1 


1 
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1 
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99 778 

99 770 
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99 744 
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99 727 

99 718 

99 710 

98 701 

98 69) 

97 684 

96 675 

95 667 

9) 658 

92 650 

90 641 

88 6 )) 

86 624 

84 616 

8) 607 

82 598 

80 590 

77 581 

75 57) 

7) 564 

72 556 

70 547 

68 5)8 

65 5)0 

6) 521 

61 51) 

58 504 

5) 496 

50 487 

48 478 

4) 470 

)9 461 

)5 45) 

)1 444 

28 4)6 

26 427 

24 418 

22 410 

18 401 

14 39) 

12 )84 



9 
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99 


718 




8 
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99 


69) 


99 777 


7 


)58 


98 


668 


99 748 


5 
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94 


644 


99 719 
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>41 


89 
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97 690 
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») 


85 
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97 662 
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79 
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70 
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1 


290 
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10 
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2 287 
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1 
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1 229 






1 
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1 201 
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Table VI I 1-9 
RAW SCORE CONVERSIONS 

AIR CONDITIONING, HEATING AND REFRIGERATION TOTAL TEST 



Raw 

SCOCt 


nit 


sea. 

Score 


Raw 

Score 


tile 


Std. 

Score 


Raw 

Score 


lilt 


Std. 

Score 


Raw 

Score 


Xlle 


Std. 

score 


204 


99 


760 


155 


81 


596 


106 


25 


452 


57 


1 


268 


202 


99 


756 


154 


81 


595 


105 


24 


429 


56 


1 


266 


202 


99 


755 


155 


80 


589 


104 


22 


426 


55 


1 


262 


201 


99 


750 


152 


80 


586 


105 


22 


422 


54 


1 


258 


200 


99 


746 


151 


78 


585 


102 


21 


419 


55 


l 


255 


199 


99 


745 


150 


77 


579 


101 


20 


416 


52 


1 


252 


198 


99 


740 


149 


76 


576 


100 


19 


412 


51 


1 


248 


197 


99 


756 


148 


76 


575 


99 


19 


409 


50 


1 


245 


196 


98 


755 


147 


75 


569 


98 


19 


405 


49 


1 


242 


195 


98 


750 


146 


74 


566 


97 


17 


402 








194 


98 


726 


145 


75 


565 


96 


16 


599 








195 


98 


725 


144 


71 


559 


95 


16 


595 








192 


98 


720 


145 


70 


556 


94 


15 


591 








191 


98 


716 


142 


70 


555 


95 


15 


589 








190 


98 


715 


141 


69 


549 


92 


14 


585 








189 


98 


710 


140 


68 


546 


91 


15 


582 
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97 


706 


159 


68 


545 


90 


12 


579 








187 


97 


705 


158 


67 


559 


89 


10 


5)5 
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97 
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157 


65 


555 


88 


10 
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97 


696 


156 


64 


552 


87 


9 


569 








184 


97 
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155 


65 


529 


86 


9 


565 








185 


97 
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154 


61 


526 


85 


8 


562 








182 


97 
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155 


59 


522 


84 


7 


559 








181 


96 
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152 


58 


519 


85 


6 


555 








180 


96 


680 


151 


56 


516 


62 


6 


55/ 








179 


96 


676 


150 


55 


512 


81 


5 


549 








178 


96 


675 


129 


55 


509 


80 


5 


545 








177 


95 


670 


128 


54 


506 


79 


5 


542 








176 


95 


666 


127 


51 


502 


78 


4 


559 








175 


95 


665 


126 


51 


499 


77 


4 


555 








174 


95 


659 


125 


50 


496 


76 


4 


552 








175 


54 


656 


124 


49 


492 


75 


4 


529 








172 


94 


655 


125 


47 


489 


74 


4 


525 








171 


94 


649 


122 


47 


486 


75 


2 


522 








170 


95 


646 


121 


46 


482 


7/ 


1 


519 








169 


95 


645 


120 


44 


479 


71 


2 


515 








168 


95 


659 


119 


42 


476 


70 


1 


512 








167 


92 


656 


118 


40 


472 


69 


1 


509 








166 


91 


655 


117 


40 


469 


68 


1 


505 








165 


89 


629 


116 


59 


466 


67 


1 


502 








164 


89 


626 


115 


58 


462 


66 


1 


299 








165 


88 


625 


114 


56 


459 


65 


1 


295 








162 


86 


619 


1 \ 5 


55 


456 


64 


1 


292 








161 


8$ 


616 


112 


54 


452 


65 


1 


289 








160 


84 


615 


111 


52 


449 


62 


1 


285 








159 


85 


609 


110 


50 


446 


61 


1 


282 








158 


85 


606 


109 


29 


442 


60 


1 


278 








157 


85 


602 


108 


28 


459 


59 


1 


275 








156 


•2 


599 


107 


26 


456 


58 


1 


272 
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CHAPTER IX 



ELECTRICAL INSTALLATION AND MAINTENANCE 



A. EXPERIMENTAL TESTS 

Table IX-1 through IX-3 present test specifications* 
description of the sample, and psychomotive characteristics of the 
experimental tests. From Table IX-3 it can be seen that the re- 
liabilities of the experimental subtests ranged from .61 to .85. The 
intercorrelation3 and factor analysis results for form A of the test 
are shown in Table IX-4. Subtest III, Construction Wiring, loads on 
factor 3 along with the Mechanical Information* Subtraction-Multipli- 
cation, and the Cube Comparison reference tests. All other achievement 
tests load on factor 1, which accounts for 47 per cent of the common 
variance and accounts for most of the correlations among the subtests. 
Subtest III, however, appears to be measuring a different dimension 
relying on abilities other than those required by the other subteste. 

Table IX-5 presents the intercorrelations and factor 
analysis for form B. Subtests IV, VI, and VII load on factor 5, 
while Subtest V loads on factor 3. The fact that the subtests are 
spread across three factors gives an indication that the subtests 
are not measuring a common dimension of achievement as was true of 
form A. 

B. FINAL TEST 

Tables 1X-6 through 1X-8 present the description of the 
sample, the psychometric characteristics, and the intercorrelationc 
of the tinal tea*-. The reliabilities of the subtests range from .70 
to .87, with the reliability of the total test being .94. The total 
test is slightly positively skewed indicating a tendency to score in 
the lover portion of the distribution. The total test distribution 
ia also slightly platykurtic. The intercorrelations in Table 1X-8 
indicate varying degrees of overlap among the subtests. 

Tables IX-9 and 1X-10 present conversions from raw scores 
to percentiles and standard scores. 



Table IX-1 

ELECTRICAL INSTALLATION AND MAINTENANCE 
Test Specifications 



CURRICULUM CONTENT AREA 



K U \ A u 



I . DIRECT CURRENT 

A. Electron physics 

B. Ohm's Law 

1# Series, parallel 
2. Series, parallel 

C. Kirchoff's Law 

1. Series, parallel 

2. Series, parallel 

D. Electrostatics and capacitance 

E. Magnetism 

1. Permanent magnets 

2. Electromagnets 

F. Meter movements 

G. Power sources 




1 2 



II. ALTERNATING CURRENT 



A. 


Rotating vectors 


2 


2 


3 


3 


B. 


Voltage and current generation 


8 


9 


4 


8 


C. 


Reactance 


2 


3 


3 


2 




1. Capacitance 


9 










2. Inductance 


4 










3. Phase angles 


2 








D. 


Impedence 


2 


1 








1. Series 












a. L-R 


3 


1 








b. C-R 












c. L-C-R 


3 


1 








2. Parallel 












a ♦ L-R 












b. C-R 












c. L-C-R 


2 


1 






E. 


Resonance 












1. Series 


1 










2. Parallel 


1 








F. 


Power factor 


9 


2 






G. 


Poly phase circuits 


4 


8 






H. 


Transformers 


13 


7 


4 




III. 


MACHINES AND CONTROLS 












A. D.C. machines and controls 


3 






1 




1. Generators 


10 


2 


2 






2. Motors 


12 


7 


1 


2 




8, A.C. machines and controls 












1. Alternator 


7 


2 


1 






2* Motor 


31 


4 


1 





O 

ERIC 



76 



lh lh on 



K 



IV. WIRING 

A. Residential 

B. Commercial 

C. Industrial 

D. Blue print readings 

V. BASIC ELECTRONICS 



A. 


Vacuum tubes 




i. 


Electron emission 




2. 


Diodes 




3. 


Tr iodes 




4. 


Multi-element 




5. 


Gas tubes 


B. 


Semi-conductors 




i. 


Solid-state physics 




2. 


Semi-conductor diodes 




3. 


Junction transistors 




4. 


Field effect transistors 


C. 


Power supply 




1 . 


Half-wave 




2. 


Full wave 

a. Bridge 

b. Conventional 




3. 


Voltage - multiplying 




4. 


Filter networks 


D. 


Amplifiers 




i. 


Voltage 




2. 


Current 




3. 


Power 


E. 


Oscillators 




i. 


Sinusoidal 




2. 


Non-sinusoidal 


INDUSTRIAL CONTROLS 


A. 


Signal devices 




i. 


Thermocouple 




2. 


Photo electric cell 




3. 


Synchro and servo mechanism 


B. 


Switching circuits 




1 . 


Time delay 




2. 


Heat and light control 




3. 


Logic 



VII. TROUBLESHOOTING (all fields) 

VIII. CARE AND USE OF EQUIPMENT 

A. Tools 

B. Instruments 

IX. SAFETY 

A. Personnel 

1. Precautions 

2. First aid 

B. Equipment 



U 



17 10 

11 

8 3 

30 11 

3 

3 3 

6 

4 

4 1 

3 
2 



8 

2 

7 

1 



A 



u 



2 



6 

1 

7 

1 

2 

1 

1 

1 

3 

2 

6 

6 

1 

1 



2 

3 

2 

13 

5 

5 

50 

2 

1 

25 

3 
7 
2 

4 



2 

1 

1 

2 

1 

1 



1 

1 

1 



8 



2 

2 

2 

1 

30 

2 

6 

1 

1 

1 



1 

3 



1 



1 

2 

1 

1 

9 



1 

1 

1 

2 

1 

1 

18 



1 



2 

1 

1 

10 
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Table IX- 2 

ELECTRICAL INSTALLATION AND MAINTENANCE 1 
First Year 

Description of Sample 



State 


No. of Inst. 


No. of Students 


Delaware 


i 


13 


Georgia 


i 


11 


New Jersey 


3 


39 


North Carolina 


6 


47 


South Carolina 


7 


94 




18 


ro 

o 



*In some states this curriculum is designated Industrial 
Electricity; in other states it is called Industrial 
Electronics . 



Table IX-3 

ELECTRICAL INSTALLATION AND MAINTENANCE 
Experimental Tests 

Description and Reliabilities 





Time Limit 


No. of 


Items 


Reliability 




Subtest 


(min) 


Form A 


Form B 


Form A 


Form B 


I 


Basic Electrical Theory 


45 


45 


45 


.72 


.70 


II 


Machines and Controls 


50 


60 


60 


.80 


.73 


III 


Construction Wiring 


35 


45 


45 


.73 


.76 


IV 


Basic Electronic Thoery 


25 


30 


30 


.72 


.85 


V 


Industrial Electronic 














Application 


30 


30 


30 


.78 


.70 


VI 


Electrical Malfunctions 


60 


60 


60 


.76 


.81 


VII 


Safety, Personal and 














Equipment 


20 


30 


26 


.61 


.68 






265 


300 


296 
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Table IX-6 



ELECTRICAL INSTALLATION AND MAINTENANCE 1 
Second Year 



Description of Sample 



State 


No. of Inst. 


No. of Students 


Delaware 


1 


12 


Georgia 


3 


18 


New Jersey 


2 


29 


North Carolina 


5 


47 


Pennsylvania 


2 


32 


South Carolina 


9 


74 




22 


212 



1 In some states this curriculum is designated 
Industrial Electricity or Industrial Electronics. 
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*Part-whole correlations 
Decimals omitted 



39 

38 

37 

36 

35 

34 

33 

32 

31 

30 

29 

28 

27 

26 

25 

24 

23 

22 

21 

20 

19 

18 

17 

16 

15 

14 

13 

12 

11 

10 

9 

e 

7 

6 

5 

4 

3 

2 

1 



T*feU xx-9 

RAW SCORE CONVERSIONS 

ELECTRICAL INSTALLATION AND MAINTENANCE SUBTEST 



1 



Std. 

Xile Score 



99 795 

99 775 

99 754 

98 733 

9 7 713 

95 692 

94 672 

93 651 

92 631 

88 610 

83 590 

77 569 

72 549 

65 528 

57 508 

51 487 

45 467 

36 446 

31 425 

23 405 

14 384 

10 364 

5 343 

1 323 



2 

Std. 

Xile Score 



99 


770 


99 


755 


99 


741 


98 


726 


96 


711 


95 


696 


93 


681 


92 


666 


90 


651 


87 


637 


86 


622 


85 


607 


80 


592 


80 


577 


77 


562 


72 


547 


68 


533 


63 


518 


60 


503 


58 


488 


53 


473 


46 


458 


37 


443 


28 


429 


21 


414 


15 


399 


10 


384 


5 


369 


3 


254 


3 


339 


1 


325 


1 


310 


1 


295 



3 



Std. 

Xile Score 



99 7 78 

99 75? 

98 737 

97 716 

94 696 

92 676 

92 655 

90 635 

87 615 

83 594 

79 574 

77 554 

71 533 

68 513 

60 492 

49 472 

40 452 

31 431 

19 411 

12 391 

7 370 

5 350 

2 330 

2 ?09 



4 

Std. 

Xlle Score 



99 


732 


99 


716 


99 


700 


98 


664 


97 


668 


96 


652 


93 


6)5 


89 


619 


83 


603 


79 


587 


74 


571 


70 


555 


63 


539 


60 


523 


54 


507 


46 


490 


44 


474 


37 


458 


33 


442 


26 


426 


20 


410 


17 


)94 


15 


378 


13 


362 


7 


)46 


4 


329 


3 


313 


2 


297 


1 


281 


1 


265 



5 

Std. 
Xile Score 



99 


781 


98 


758 


98 


735 


98 


712 


97 


C69 


95 


666 


93 


643 


89 


620 


86 


597 


79 


574 


74 


551 


66 


529 


56 


506 


49 


483 


41 


460 


30 


437 


24 


414 


17 


391 


10 


368 


8 


345 


3 


322 


1 


299 



6 

Std. 

Xile Score 



99 


800 


99 


800 


99 


800 


99 


785 


98 


768 


98 


752 


98 


736 


97 


719 


96 


703 


96 


687 


95 


670 


93 


654 


93 


638 


86 


621 


87 


605 


84 


589 


60 


572 


78 


556 


73 


540 


62 


52) 


56 


507 


52 


491 


46 


474 


40 


458 


30 


442 


23 


425 


19 


409 


15 


392 


10 


376 


6 


360 


3 


343 


2 


327 


2 


311 


2 


294 


2 


278 


1 


262 


1 


245 


1 


229 


1 


213 



7 

Std. 

Xile Score 



99 790 

99 765 

99 741 

99 716 

98 691 

98 667 

97 642 

90 617 

86 593 

80 568 

67 543 

56 519 

48 494 

40 469 

30 444 

23 420 

19 395 

12 370 

7 346 

5 321 

4 296 

2 272 

1 247 

1 222 

1 200 
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Table IX-10 



RAW SCORE CONVERSIONS 

ELECTRICAL INSTALLATION AND MAINTENANCE TOTAL TEST 



Raw 

Score 


%ile 


Std . 
Scor*i 


Raw 

Score 


%ile 


Std. 

Score 


Raw 

Score 


Ule 


Std. 

Score 


Paw 

Score 


%ile 


Std. 

Score 


201 


99 


800 


149 


93 


664 


97 


50 


483 


45 


1 


301 


200 


99 


800 


14S 


93 


660 


96 


49 


479 


44 


1 


298 


199 


99 


800 


147 


92 


657 


95 


47 


476 


43 


1 


294 


198 


99 


800 


146 


91 


654 


94 


45 


472 


42 


1 


291 


197 


99 


800 


145 


91 


650 


93 


43 


469 


41 


1 


287 


196 


99 


800 


144 


91 


647 


92 


41 


465 


40 


1 


284 


195 


99 


800 


143 


91 


643 


91 


39 


462 


39 


1 


280 


194 


99 


800 


142 


91 


640 


90 


38 


458 


38 


1 


277 


193 


99 


800 


141 


SI 


636 


89 


36 


455 


37 


1 


273 


192 


99 


800 


140 


90 


633 


88 


35 


451 


36 


1 


270 


191 


99 


800 


139 


88 


629 


87 


34 


448 


35 


1 


266 


190 


99 


800 


138 


88 


626 


86 


32 


444 


34 


1 


263 


189 


99 


800 


137 


88 


622 


85 


31 


441 


33 


1 


259 


188 


99 


800 


136 


88 


619 


84 


30 


437 


32 


1 


256 


187 


99 


797 


135 


87 


615 


83 


30 


434 


31 


1 


252 


186 


99 


793 


134 


87 


612 


82 


28 


430 


30 


1 


249 


185 


98 


790 


133 


86 


608 


81 


26 


427 


29 


1 


245 


184 


98 


786 


132 


85 


605 


80 


26 


423 


28 


1 


242 


183 


98 


783 


131 


85 


601 


79 


24 


420 


27 


1 


238 


182 


98 


779 


130 


84 


598 


78 


22 


416 


26 


1 


235 


181 


98 


776 


129 


83 


594 


77 


20 


413 








180 


98 


772 


128 


82 


591 


76 


17 


409 








179 


98 


769 


127 


82 


587 


75 


15 


406 








178 


98 


765 


126 


81 


584 


74 


15 


402 








177 


98 


762 


125 


80 


580 


73 


14 


399 








176 


98 


758 


124 


79 


577 


72 


13 


395 








175 


98 


755 


123 


78 


573 


71 


11 


392 








174 


98 


751 


122 


78 


570 


70 


11 


388 








173 


98 


748 


121 


78 


566 


69 


10 


385 








172 


98 


744 


120 


76 


563 


68 


9 


381 








171 


98 


741 


119 


76 


559 


67 


9 


378 








1/0 


98 


737 


118 


74 


556 


66 


7 


374 








169 


98 


734 


117 


72 


552 


65 


7 


371 








168 


98 


730 


116 


71 


549 


64 


7 


367 








167 


98 


727 


115 


68 


545 


63 


5 


364 








165 


98 


723 


114 


67 


542 


62 


3 


361 








165 


98 


720 


113 


67 


538 


61 


3 


357 








164 


98 


716 


112 


66 


535 


60 


2 


354 








163 


97 


713 


111 


66 


531 


59 


2 


350 








162 


97 


709 


110 


65 


528 


58 


2 


347 








161 


96 


706 


109 


63 


524 


57 


2 


343 








160 


96 


702 


108 


60 


521 


56 


2 


340 








159 


95 


699 


107 


59 


517 


55 


2 


336 








158 


95 


695 


106 


58 


514 


54 


2 


333 








157 


94 


692 


105 


55 


510 


53 


2 


329 








156 


94 


688 


104 


54 


507 


52 


1 


326 








155 


94 


685 


103 


53 


504 


51 


1 


322 








154 


94 


681 


102 


53 


500 


50 


1 


319 








153 


94 


678 


101 


52 


497 


49 


1 


315 








152 


93 


674 


100 


52 


493 


48 


1 


312 








151 


93 


671 


99 


52 


490 


47 


1 


308 








150 


93 


667 


98 


51 


486 


46 


1 


305 
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chapter X 



RADIO AND TELEVISION SERVICING 

A. EXPERIMENTAL TESTS 

Tables X-l through X-3 present test specifications, a 
description of the sample, and detailed psychometric characteristics 
for the experimental Radio and Television Servicing tests. From 
Table X-3 it can be seen that the reliabilities of the experimental 
subtests ranged from .22 to .90. Table X-4 presents the intercorrela- 
tions and factor analysis results for form A of the experimental test. 

It can be seen that all of the subtests except X load on factor 1. 

This factor, which accounts for 43 per cent of the common variance, 
appears to be the one underlying the general ability needed for success 
in the Radio and Television Servicing curriculum. None of the reference 
tests load on this factor. Subtest III, Vacuum Tubes, has a moderate 
loading on factor 4 but the fact that this is a bipolar factor suggests 
that it is not a meaningful dimension of performance. 

Table X-5 presents the intercorrelations and factor analysis 
results for form B of the experimental test. All the sub tests, 
including sub test X, load on factor 1, which accounts for 49 per cent 
of the common variance. Factor 2 seems to be a bipolar factor with the 
performance tests, TV-Dynamic and TV-Static, representing manipulation 
abilities and the Cube Comparison, Subtraction-Multiplication, and 
Wide Range Vocabulary reference tests representing general and abstract 
reasoning. The two analyses agree fairly closely, although the refer- 
ence tests for form A show some moderate loadings on a variety of 
factors whereas a few tests load on factor 2 for form B. 

B. FINAL TEST 

The description of the sample for Radio and Television 
Servicing is presented In Table X-6 and psychometric characteristics 
for this test are presented in Table X-7* It can be seen from this 
table that the subtests have reliabilities ranging from .78 to .86, 
with a total test reliability of .96. It can also be seen from this 
table that the skewness for the subtests is not large except for 
Subtest II. Kurtosis, although negative for most of the subtests, is 
not large except for Subtest II which is highly positive, i.e., 
leptokurtic. Interpreted thusly, Subtest II had the students' results 
clustering very significantly about the mean, i.e., there was not a 
wide range of scores. From the intercorrelations in Table X-8 it can 
be seen that the subtests have moderate to high intercorrelations. 

The homogeneous intercorrelations would Indicate that the subtests all 
measure about the same degree of common variance, as was found in the 
factor analyses of the experimental tests 

Norms for converting raw scores to percentiles, and standard 
scores are presented in X-9 for subtests and Table X-10 for total test 
scores. 
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Table X-l 

RADIO-TELEVISION S EL. ICING 



Test Specifications 







CURRICULUM CONTENT AREA 


K 


U 




A 

u 


I. 


FUNDAMENTALS OF DIRECT CURRENT 












A. 


Series 


9 


4 


5 


2 




B. 


Parallel 


8 


3 


4 






c. 


Combination (series-parallel) 


5 


2 


3 




II. 


FUNDAMENTALS OF ALTERNATING CURRENT 












A. 


Series 


10 


34 


14 






B. 


Parellel 


12 


22 


10 






c. 


Combination (series-parallel) 


10 


12 


4 






D. 


Resonance 


9 


17 


3 




III. 


VACUUM TUBES 












A. 


Diode 


13 


3 


1 






B. 


Triode 


15 


15 


3 


3 




c. 


Tetrade 




3 


1 






D. 


Pentode 


9 


2 








E. 


Special 


5 


5 


1 




IV. 


POWER SUPPLY 












A. 


Half-wave 


4 


2 


2 






B. 


Full-wave 


2 


4 


3 


1 




C. 


Bridge 


2 




2 






D. 


Doublers 




2 








E. 


Filters 


5 


1 


2 






F. 


Special 


1 


1 


1 




V. 


AMPLIFIERS 












A. 


Audio 


30 


16 


13 






B. 


Radio-frequency (R.F.) 


14 


6 


2 


1 




C. 


Video 


16 


5 


4 


1 




D. 


Special 


7 


2 


2 




VI. 


SPECIAL CIRCUITS 












A. 


Oscillator 


20 


5 


2 






B. 


Detector 


8 


3 








C. 


Conventor 


1 


1 








D. 


Special 


3 


6 


5 




VII. 


SEMI-CONDUCTORS 












A. 


Diode 


24 


6 


1 






B. 


Transistor 


50 


7 


1 


1 




C. 


Other or special 


9 


1 







O 
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VIII. RADIO RECEIVER 

A. T.R.F. (Tuned radio frequency) 

B. Super het . ndyne 
1 • Home 

a. A.M. 

b. F.M. 

2. Auto 

a. A.M. 

b. F.M. 

C. Stereo Multiplex 

D. Multiband 

E. Special 

IX. TELEVISION 

A. Black and white 

B. Color 

X. TEST EQUIPMENT AND TOOLS 

A. Types 

B. Use 

C. Maintenance 

D. Safety Practices 



K U A. 

k 



11 3 5 



3 2 2 

3 11 

3 

3 

4 

2 1 



33 27 13 

34 20 7 



6 2 2 

6 5 

1 

2 1 



Table X-2 

RADIO AND TELEVISION SERVICING 1 
First Year 



Description of Sample 



State 


No* of Inst* 


No* of Stu. 


Delaware 


i 


10 


Georgia 


i 


13 


North Carolina 


8 


73 


South Carolina 


2 


13 




12 


109 



This curriculum is sometimes designated Industrial 
Electronics or Electronics Servicing* 



87 




Table X-3 



RADIO AND TELEVISION SERVICING 
Experimental Tests 



Description and xiellablllties 





Subtest 


Time Limit 
(Min) 


No. 

Form 


► of Items 
A Fovm B 


Reliability 
Form A Form B 


I 


Fundamentals of Direct 
Current 


20 


24 


23 


.71 


.71 


II 


Fundamentals of Alterna- 
ting Current 


45 


40 


40 


.78 


.50 


III 


Vacuum Tubes 


20 


22 


22 


.62 


.72 


IV 


Power Supply 


15 


17 


17 


.47 


.54 


V 


Amplifiers 


20 


21 


20 


.55 


.74 


VI 


Special Circuits 


20 


20 


23 


.77 


.85 


VII 


Semi-Conductors 


20 


23 


23 


.73 


.64 


VIII 


Radio Receiver 


15 


16 


15 


.22 


.52 


IX 


Television 


60 


64 


63 


.90 


.89 


X 


Test Equipment and Tools 


5 


9 


9 


.59 


.53 






240 


256 


255 
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INTERCORRELATIONS AND FACTOR LOADINGS FOR 



< 

g 

£ 



H 







CM 


rH 


O' 


o 


rH 


Cl 


xO 


O' 


\D Ml Ml vt vt vt 


vt 


O' vD 


O' CM vO vO 










X, 


Ml 


vt 


xO 


vO 


VO 


sO 


Ml 


Ml SO O Ml SO 00 


vt 


d rH 


Ml ‘O O' xO 










vt 


O' 




vt 


O' 


fv. 


xO 


vt 


25 

40 

15 

63 

13 

00 


Ml 


Ml O 


14 

09 

38 

62 


CM O 






w 




rH 


9 


i/I 


rH 


o 


rH 


o 


9 


Ml rH 


* i 






t>0 






T 














T 


1 1 




rv o 






a 


























rH O 






vf 


























rH 






3 

Q 


CO 


rH 


CO 


Cl 


rv 


Cl 


rH 




00 CN vt rv (S VO 


d 


rH Ml 


rH Ml xO xO 


vt 00 








CM 


o 


rH 


O 


o 


Cl 


CM 


rH rH O rH tH 00 


d cm d 


CO 


t « 
















1 








T 








O' CH 
rH 00 






Vi 

"S 
































V 

U 


CM 


CM 


i/i 


Cl 


$ 


-05 


Ml 


Ml 


O N N Cv vt CM 


•H 


-11 

08 


d xO xO vt 


rH vt 






O 

4 




CM 


CM 


CM 


rH 


rH 


CM O rH O Cv d 


? 


cp *h 


• • 
O d 






k 


























CM xO 








iH 


CM 


if) 


O' 


Ml 


O' 


CM 


O 


1/1 S rH d d d o 


Cv CM 


xodrvflo 


d d 










vO 


x£> 


vt 






Cv 




vO vO H d CM O 
1 


vt 


rH rH 


rH rH CM vt 


• • 
d d 
vt vt 






s~ 


AX 


\0 


x£> 


CM 


vt 




Ml 




H O' x0 CM CM CM 
vt vt O vO O H 


Cv 


vt vt 


O' Ml CM I 








if) 
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Ml 


vt 


vt 
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CM 


vt 
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0 vt xo i 

1 






ri 
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• N 
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vt 


00 
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00 
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rH vt J 


Vt 






d 


O 


vt 


CM 


CM 


Ml 


Ml 


rH CM CM 
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> fl 
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CM 
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00 1 
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N O 
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ci 
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Cl 


CM 


CM CM H CM vO d 
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O CM 


xO [ 








AVLrt 


* 


CO 


rH 


‘t 


v£> 


vt 


rH 


rH CM Ml CM Ml rH 


Ml 


rH x*> 


| 
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Cl 


rH 
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CM 


CM 


vt d rH d d CM 


rH 

1 










« 

u 




00 
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CM 


O 


Cl 


MA HN O vt 


vt 


d ( 








w 

0 




CM 


rH 


CM 
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O 

1 


CM 


O 


rH rH O O CM CM 
1 


CM 


CM i 








H 




Oi 


8 


CM 


C“. 


CM 


CM 


rH 


CM 


03 

00 

02 

38 

01 

16 


O 


1 








0 
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9 
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1 








U 










1 


T 








i i i 
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I I 










tfi 

c 


Hi 

0 




HS 


vO 


i/I 


i/I 


00 


vO 


n 


00 


00 rH O' rH 1 










5 


« 




CM 


CM 




o 


O 


CM 


CM 


rH rH O O Ml | 










•H 














T 


















AJ 
































a 

rH 




QMS 


CO 


Cl 

d 


O 

CM 


s 


20 


•H 

vt 


Cl 


vt vt rH Ml j 
HQH H 1 










0 






















T i 










P 
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Decimal* omitted 
(1) Performance Teat* 



Table X-5 

INTERCORRELATIONS AND FACTOR LOADINGS FOR 
RADIO AND TELEVISION REPAIR 
Experimental Test — Form B 
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RADIO AND TELEVISION SERVICING 
Second Year 

Description of Sample 
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Table X-7 
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CHAPTER XI 



DIAGNOSTIC PERFORMANCE MEASURES 

The following three summaries are from thesis research 
efforts conducted by doctoral graduate students while at the Univer- 
sity of Illinois. The studies are diagnostic ability measures for 
three of the trade areas investigated in this Project: Machinist, 

Radio-Television Servicing, and Automotive Mechanics. The studies 
were conducted on a sample of those students who took the paper- 
and-pencil test in each area. 



AUDITORY DIAGNOSTIC PERFORMANCE AS A CRITERION 
MEASURE FOR MACHINISTS - D. W. Becker 1 

The problem of this study was to determine if auditory 
diagnostic performance exists as a separate dimension of machining 
performance. 

In the initial phase of the study an instrument, Auditory 
Achievement Test for Machinist (AATM) , was developed. The AATM was 
constructed by setting up machining operations In which typical mal- 
functions were "built in." The sounds produced by the malfunctioning 
processes were then recorded with high fidelity tape recording equip- 
ment. Each sound was prefaced with a brief description of the machin 
ing operation involved and four possible causes of the sound were 
presented. After hearing the sound, through binaural head phones, 
the respondent selected from the several alternatives the one which 
supposedly identified the malfunction and marked it on the printed 
answer sheet. The entire test of sixty-four questions, including 
instructions, was placed on the tape. The total running time for 
AATM was one hour and twenty minutes. 

Three different samples were used in the study. The first 
was chosen from a population having no appreciable amount of machin- 
ing experience. The second sample was composed of students who had 
Just completed a one year post high school machinist training program 
and the third sample contained experienced machinists who were work- 
ing in the trade. 

The odd-even reliabilities on AATM of -.122 for nonmachinists 
.261 for student machinists, .558 for experienced machinists, and 
.513 for the total 6Ample tested were not considered high enough to 
make fine distinctions of auditory diagnostic performance. It was 
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encouraging, however, that the highest reliability reported was for the 
machinist group. The belief that reliabilities could be improved 
through AATM revision was supported. 

The construct validity, that auditory diagnostic performance 
increases with auditory diagnostic experience, was tested and supported. 
Comparisons of achievement between the groups tested by one-way analysis 
of variance and by separate t tests between the groups were made. The F 
value was found to be significant beyond the .0001 level and each of 
the three one tailed t tests produced a t value which was significant 
beyond the .0005 level. 

A correlation coefficient of .189 (p< .025) was considered 
too low to support the peer nomination technique as a concurrent measure 
of auditory diagnostic achievement. 

The value of auditory aptitude in predicting auditory diagnostic 
performance was supported. A multiple correlation between AATM and 
the auditory aptitude battery was .428 (p < .0005) and a revised AATM 
with an increased range and reliability should significantly increase 
the predictive potential of the Auditory Aptitude Test Battery. 

The independence of AATM and the paper-and-pencil Achievement 
Test for Machinist was only partially supported. A comparison of these 
two measures produced a correlation coefficient of .315 (p < .005). 



ICONIC COMPARISON OF PHOTOGRAPHS AND THE LIVE TELEVISION SCREEN 
IN VISUAL DIAGNOSTIC ABILITY - Jarrel Hoffer* 

This research centered around two major problems. The first 
was to develop an achievement test to measure the additional dimension 
of visual diagnostic ability. The second problem was to test the 
iconic equivalence of photographs with motion cues and live screen 
presentation of defective television reception for testing purposes. 
Related questions concerning reliability, validity, and the dimensions 
of visual diagnosis were also studied. 

A panel of radio-television Instructors and technicians was 
utilised to write questions and Judge the appropriateness of items for 
the test. The malfunctions were wired into a Tele-Lab (R.V.S. Indust- 
ries, Cleveland, Ohio; Courtesy: Mr. Alvin Stumpf) trainer so that they 
could be switched in, at will, for presentation during the test. Fifty 
multiple choice questions representing twenty-seven malfunctions were 
used. The malfunctions affected the audio only, the video only, or 
both the audio and the video. This test is the Visual Diagnostic lest 
for Television Servicing Dynamic or dynamic test. The live screen 
used in the dynamic test served as the photographic model for the 
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Visual Diagnostic Test for Television Servicing Static or static test. 
Verbal notion cues were presented beside each photograph on the static 
test. The static and dynamic tests were identical except for the 
method of presenting the visual information in the malfunctions. To 
equalize the two tests , a statement of the audio condition was presented 
within each question. 

The static and dynamic tests were administered to eighty-nine 
students who were completing one year programs in radio-television 
servicing. For economic and logistic reasons, the students were admin- 
istered both the static and dynamic tests in one sitting. They were 
divided into two groups so that approximately one-half of them took the 
static test first and one-half took the dynamic test first. The 
students also took, at a different sitting, a three hundred item 
multiple choice test for knowledge of basic electronics, the RTV test. 

The static and dynamic tests were also administered to a sample 
of twenty-four technicians who were employed full-time in radio- 
television .ervicing. 

Hypotheses 1 and 2 stated that the static and dynamic tests 
are reliable. The Kuder-Richardson formula 14 yielded a validity index 
of .728 and .698, respectively, for the static and dynamic tests. This 
is a moderately high reliability! however, since the equipment and 
testing procedures have not been perfected this reliability was con- 
sidered adequate and hypotheses 1 and 2 were accepted. 

Hypotheses 3 and 4 stated that the static and dynamic tests 
are valid measures. Students and technicicans were compared using 
analysis of variance. An F ration of 29.31 was obtained which is signif- 
icant beyond the .01 level; therefore, hypotheses 3 and 4 were accepted. 

Hypothesis 5 stated that photographs with verbal motion cues 
are equivalent to live screen presentation of defective television 
reception for testing purposes. A product-moment correlation of .81 
was obtained between the static and dynamic tests. A correlation of 
.71 is the highest correlation that is theoretically possible between 
the tests, estimated from the reliabilities of the tests, and is less 
than the obtained correlation. When corrected for attenuation, the 
correlation is slightly greater than unity. The assumptions underlying 
the reliability formula were violated, giving an underestimate of the 
reliabilities. This could explain why the obtained correlation was 
higher than theoretically possible and also why the correlation 
corrected for attenuation is greater than unity. A high correlation 
was considered to be strong evidence that the tests are equivalent. 

The static and dynamic tests were also compared by analysis of var- 
iance. F ratios of 7.88 for students and 10.02 for students and 
technicians were obtained and are significant beyond the .01 level. 

Only partial support was given to this hypothesis from the statistical 
tests; therefore, hypothesis 5 was rejected. The requirements of 
equivalence are quite rigorous and are frequently not met by well 
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recognized tests. The static and dynamic tests do meet the most 
important requirements of equivalence; therefore from a practical 
standpoint, the tests may be considered equivalent. 

Hypotheses 6 and 7 stated that the static and dynamic tests 
are independent of trade-related cognitive knowledge as measured by a 
paper and pencil test of knowledge of basic electronics. The static 
test correlated .58 and the dynamic test .60 with the RTV test, a paper 
and pencil test of knowledge of basic electronics. These correlations 
indicate a reasonably strong relationship; therefore, the static and 
dynamic tests are not independent and hypotheses 6 and 7 were rejected. 

Hypotheses 8 and 9 stated that the static tests each measure a 
single dimension. The tests were factor analyzed using a principal 
axis factor analysis with varimax rotation. The results of the analysis 
indicate that, on both the static and dynamic tests, factors two, three, 
and four are each about one-half as strong as factor one. This indicates 
a more complex relationship rather than a single dimension; therefore, 
hypotheses 8 and 9 were rejected. 

Hypothesis 10 stated that the static and dynamic tests are 
measures of the same dimension. This relationship was studied with 
factor analysis. The results indicate that the items o.i* the two tests 
do load on the factors in a similar manner. The factors of the two tests 
were also similar with regard to the kinds of problems that loaded on 
each of the factors. The static test correlated .58 and the dynamic 
test correlated .60 with the RTV test. The results of the factor 
analysis and the correlations were taken as evidence that the static 
and dynamic tests are measures of the same dimension; therefore, 
hypothesis 10 was accepted. 



AUDITORY AUTOMOTIVE MECHANICS DIAGNOSTIC 
ACHIEVEMENT TEST (AAMDAT) - R. A. Swanson 1 

It was the purpose of this study to develop and validate a test 
to measure the ability to diagnose malfunctions in automobiles through 
the auditory sense. The goal was to develop a test having from forty 
to sixty auditive malfunctions that would take approximately one hour 
to administer. The completed test, one hour in length, had a total 
of forty-five items. These malfunctions were built into automobiles; 
e.g., installing a bad connecting rod hearing into an otherwise per- 
fectly running engine. Using a high quality binaural recording- 
reproducing system the malfunctioning automobiles were recorded. The 
malfunctioning sounds that received the highest combined ranking from 
a staff of automobile mechanics instructors and automobile mechanics, 
ranking independently, were selected for inclusion in the test- 

The Auditory Aptitude Test Battery (Fleishman and Friedman, 
1957) was shortened for use in this study. This was done to keep the 
total auditory achievement and aptitude testing time within a two and 

*Now at Bowling Green (Ohio) State University 
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one half hour time limit. The inclusion of this test battery was to 
determine how well auditory aptitude predicts auditory diagnostic ability 
in auto mechanics. 

Auditory diagnostic achievement as measured by the AAMDAT was 
found to have a reliability of .71 for the total group (N ■ 269). The 
reliability for the no experience group (N ■ 67) was .335, .433 for 
the first year auto mechanic students (N ■ 91), .436 for the graduating 
second year auto mechanic students (N ■ 44). In its present form the 
AAMDAT cannot be considered a sufficiently reliable test to make fine 
discriminations in auditory diagnostic ability between individuals 
within any one of the groups in this tudy. The belief that a careful 
revision of the AAMDAT would result in an instrument with this dis- 
criminating ability was supported in the analysis and discussion of 
the data. 

The construct validity of the AAMDAT was tested and supported 
through the theoretical construct that auditory diagnostic ability 
increases with experience. The auto mechanics achieved significantly 
higher (P<.0005) than the graduating auto mechanics students, whose 
achievement was in turn significantly higher (P<.01) than the first 
year auto mechanics students, whose achievement was signif iciantly 
higher (P<.0005) than the no experience group. An analysis of variance 
computation of the same data produced an F value significant beyond 
the .0001 level. 

The concurrent validity of the AAMDAT, which was evaluated by 
correlating AAMDAT achievement to peer nominations on the same dimension, 
was partially supported. These independent measures of auditory diag- 
nostic ability correlated .256 for the first year auto mechanics stu- 
dents, .327 for the graduating auto mechanics students, and .161 for 
the auto mechanics. These low correlations may be partially explained 
by the limited range and reliability on the AAMDAT, as ‘.ell as the 
questionable validity of the peer nomination technique as an intermediate 
criterion. 

A principle axes factor analysis on the AAMDAT items produce! 
several groups of items having high intercorrelations. These independent 
dimensions of auditory diagnostic ability were reviewed in order that 
they be identified in psychological terms. Factor one was identified 
as a basic experience factor, factor two a subtle tonal memory factor, 
and factor three a rhythm factor. The weaker remaining three factors 
were left unidentified. 

The potential of the Auditory Aptitude Test Battery as a 
predictor of auditory diagnostic achievement was revealed in the multiple 
correlation of the nine predictor tests to the AAMDAT. A -ultiple 
correlation of .41 (P<.0001) between these measures was achieved for the 
graduating auto mechanics students. A revised AAMDAT with an increased 
range and reliability should significantly increase the predictive 
potential of the Auditory Aptitude Battery. 



0 



99 



The independence of AAMDAT and paper and pencil auto mechanics 
test achievement was supported. The graduating auto mechanics students 
resultes on these two measures had a .249 correlation. 



APPENDIX 



A* DESCRIPTION OF PERFORMANCE TESTS 

The following is a brief description of the performance tests 
used* primarily in the first year's testing program, in addition to 
those discussed in Chapter XI# 

Plug and Ring Gauge Test (PR) 

This test was used to measure the fine tactile kinesthetic 
sensitivity of students with respect to their ability to discriminate 
by feel between the different fits of plugs and rings# It was believed 
that through trade training in Automotive Mechanics; Air Conditioning, 
Heating and Refrigeration; Machinist; and Electrical Installation and 
Maintenance, students would be able to discriminate a skill in ranking 
the fits according to size in a manner superior to untrained students. 

Three sets, each with five plugs and rings, were used as the 
testing equipment. These metal plugs were machined so that when a 
standard one-inch ring was placed on each a distinct fit was obtained. 

The task was to rank the five plugs according to size from largest to 
smallest. This was a rank-order test; the score being the difference 
between the correct rankings and the students 1 ranking. 

Measurement Pod Test (MP) 

This test was administered to students in Machine Shop and 
Auto Mechanics and measured the degree of skill with which precise 
measurements could be made. A tactile kinesthetic sensitivity factor 
was also present because of the importance of "touch 11 and "feel" in 
performing these tasks. 

The measurement pod was composed of fifteen gauge blocks 
connected in such a manner as to provide for four measurements using 
feeler gauges and four measurements using one and two inch micrometers. 

The student was required to list his answers to the fourth decimal 
place, which involved interpolation in some of the cases. A time limit 
of six minutes was imposed, and the score for the test was the absolute 
sum of the variances expressed as a whole number of ten thousandths of 
an inch. 



Electircal Trouble-shooting Test for Automotive Mechanics (TS) 

The object of this test was to measure the student's ability to 
locate and identify electrical malfunctions wherever they occur in the 
car's system. 
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A rectangular metal box, on which were mounted all the electri- 
cal components found in an automobile, was constructed so that by means 
of a switch panel, eighteen different electrical malfunctions could be 
introduced into the system. Circuits involving the ignition, head and 
tail lights, directional signals, parking lights and stop lights were 
used. A series of junction and fuse panels, externally mounted, 
provided the means by which the student could trouble-shoot the circuits 
at different points using a jump cable and probe. 

The test was constructed so that the student responded to a 
written statement about a particular malfunction, i.e., statements were 
identical to those which might be voiced by a customer who describes 
what he thinks is wrong with his car. The student had to locate and 
identify the trouble and give his answer to the test administrator 
who noted it on the answer sheet. 

The score was the number of items done correctly within the 
twenty minute time limit. 

Dynamometer Test (Dyn) 

Accuracy with the dynamometer was used as one measure of 
kinesthetic sensitivity as it has proven to be a reliable measure. It 
was administered to skilled students in the Automotive Mechanics; Air 
Conditioning, Heating and Refrigeration; Machinist; and Electrical 
Installation and Maintenance curricula. The results were compared with 
the unskilled students acting as a control group. Both skilled and 
unskilled groups were divided into two groups, one with knowledge of 
results, one without. While blindfolded, the subject was directed to 
exert pressure of 20 pounds by squeezing the dynamometer in his hand. 

The absolute variation over several trials was used as raw score. 

Tactile-Kinesthetic Sensitivity Test (TK) 

This was another apprcach to measure fine tactile-kinesthetic 
sensitivity through a newly developed piece of equipment. This test 
was administered to students in Automotive Mechanics; Air Conditioning, 
Heating and Refrigeration; Machinist; and Electrical Installation and 
Maintenance. There was a push and pull rod suspended in a magnetic 
field. By increasing or decreasing the electrical input, the pressure 
required to move the tod would vary. The task was to compare a 
designated standard weight with a different weight by comparing the 
amount of pressure required to pull the rod at various field intensities. 
The subject was required to tell whether the pressure was higher or lower 
than the standard pressure. 

Automotive Diagnostic Scope Test (D-S) 

This test was designed to measure the student's ability to 
diagnose ignition faults in an automobile engine using an analyzer 
scope. His ability to identify correctly the cause of malfunction by 
this method was considered an important facet of performance achieve- 
ment in automotive mechanics. There were two forms of the test, static 
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and dynamic* The static test used a booklet of pictures of a scope 
screen and a question and answer sheet. The dynamic portion of th^ 
test employed the actual scope. By using an engine simulator, patterns 
identical to those listed on the static test booklet were imposed upon 
the screen. Although the items on each test were identical, they were 
not offered in the same sequence nor were the multiple choice answers 
listed in the same order. In both parts of the test, each item was 
timed at thirty seconds. The score was the number of correct responses 
minus one third of the incorrect responses. After initial administra- 
tion of the two forms, a comparison of reliabilities and the relationship 
between the two was examined. 

Mach i ne Indexing Test for Machinists (Ind) 

This test was designed to measure the tactile-kinesthetic 
sensitivity which is developed through Machine Shop training and which 
is necessary to perform certain tasks upon prcision machine tools. 

In the machine shop, the most up to date vertical or horizontal 
milling machine was used to demonstrate and measure the student's skills. 
Using only the cross feed screw, the subject was required to perform a 
series of ten movements, moving the table in and out according to 
instructions given verbally by the test administrator. An indicator 
mounted on the machine revealed to the test administrator the results 
of the subject's moves. The score was the total absolute variance of 
all ten moves. 

Truing Test for Machinists (Tru) 

This test measured the learned eye-hand-mind coordination of 
students. A plug of convenient diameter was placed in a four jaw 
chuck which was mounted in an engine lathe. Prior to the test, the 
plug was offset 1/16". The student was required to perform four tasks 

in a ten minute period. He had to true the plug to within ±.0005 as 

task tfl, task #2 was to offset the plug by 1/16" ± .0005; tasks #3 and 

// 4 were the reverse of tasks #1 and //2. These tasks required that the 
student return the equipment to its original setting. This rendered 
it ready for the next student. 

This was a timed test. Each task was timed and noted on the 
score sheet provided. The score was the total time needed to accomplish 
the four tasks expressed as a whole number of quarter minutes. This 
score would inversely relate to the overall skill of the subject. 

B. KIT OF REFERENCE TESTS FOR COGNITIVE FACTORS 1 

In various research over the last several years, many separate 
factors of aptitude and achievement have been identified. In 1951, 
Educational Testing Services (ETS) began a project to select those 
factors which could be agreed upon as measuring separate facets of 
aptitude or achievement and to develop instruments which would measure 
these factors. In 1958, the Office of Maval Research began supporting 
the effort. Usin g committees of the most respected researchers in the 

^Developed by Educational Testing Service, Princeton, New Jersey 
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United States, ETS led the activity which resulted in the selection of 
twenty-four factors which were considered to be independent facets of 
aptitude and the naming of more than seventy tests deemed suitable for 
measuring these factors. Each factor has at least three tests designed 
for different grade levels or using different approaches to measurement 
of tli« aptitude factor. The purpose of the Kit is best defined by the 
authors themselves. In their words: 



The purpose of the Kit is to provide research workers with a 
sat of teats for defining each of these factors. It is in- 
tended that use of the Kit tests for this purpose will 
facilitate interpretation and the confident comparison of 
one factor study with another. In the past it has often been 
necessary to cross-identify the factors in two studies by 
means of psychological interpretation alone, sometimes 
without any tests common to the two studies. It is un- 
desirable that this kind of subjective identification prevail. 
There are now in existence several techniques for objectively 
comparing a factor found in one analysis with that found in 
another. All methods of this kind require sets of tests that 
r.re common to the two studies. Use of the Kit tests should 
provide this common ground for the objective comparison of 
factors . 



Some of the factors identified in the Kit have only been 
isolated in laboratory research while others of the factors have been 
readily identified in field research. The following pages describe 
those factors which this project staff and others with expert opinions 
felt to be contained in achievement in trade and technical education 
and were subsequently used in this testing program as a means of 
factor identification. The abbreviations used for the Reference Tests 
are shown in parentheses. 



x Factor Fw: Word Fluency The facility in producing isolated words 

that contain one or more structural, essentially 
phonetic, restrictions, without reference to the meaning 
of the words. 

Test: Word Endings (WE) 



x Factor I: Induction Associated abilities involved in the findings 

of general concepts that will fit sets of data, the 
forming and trying out of hypotheses. 

Test: Figure Classification (FC) 



x Factor Mk: Mechanical Knowledge The knowledge of mechanical prin- 

ciples, devices and tools, acquired through experience 
and training. 

Test: Mechanical Information (MI) 

x Factor N. Number Facility The ability to manipulate numbers in 
arithmetical operations rapidly. 

Test: Subtraction and Multiplication (SM) 
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x Factor 0: 



x Factor P: 



x Factor R: 



x Factor Rs: 



x Factor S: 



x Factor V; 



x Factor Vz: 



x indicates 



ERJC 



Originality The ability to produce remotely associated , 
clever, or uncommon responses. 

Test: Symbol Production (SP) 

Perceptual Speed Speed in finding figures, making 
comparisons, and carrying out other very simple tasks 
involving visual perception. 

Test: Number Comparison (NC) 

General Reasoning The ability to solve a broad range 
of reasoning problems including those of a mathematical 
nature . 

Test: Ship Destination (ShD) 

Syllogistic Reasoning The ability to reason from stated 
premises to their necessary conclusions. 

Test: Inference (Inf) 

Spatial Orientation The ability to perceive spatial 
patterns or to maintain orientation with respect to 
objects in space. This factor seems to involve percep- 
tion of the position and configuration of objects in 
space, perhaps best thought of as space with the observer 
himself as a reference point. These tests were given 
under speeded conditions. 

Test: Cube Comparison (CC) 

Verbal Comprehension The ability to understand the 
English language. 

Test: Wide Range Vocabulary (WRV) 

Visualization The ability to manipulate or transform 
the image of spatial patterns into other visual arrange- 
ments. In this factor, the observer seems removed from 
the stimulus pattern in that he appears to manipulate 
and alter Its image. 

Test: Surface Development (SuD) 



factor measured In one or more curriculum 
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